Hello,

Apologies for the delay in getting back to you on this. I checked your configuration and it seems correct, so I was also asking some other Manila people for possible reasons why you are seeing this issue.

Can you launch the manila-share pod in debug mode and attempt to issue ceph commands? Apparently the manila-share can't connect to the Ceph cluster.
Are your Ceph cluster and manila pod running on the same kubernetes cluster and namespace?

Regards,
carloss

Em qui., 13 de jun. de 2024 às 11:34, Shubham Kumar Yadav <shubham.kumar.yadav369@gmail.com> escreveu:
hello, 
I'm trying to install manila in my openstack cloud but having problem with "Authorizing the driver to communicate with Ceph" 

1 -> i have created a configmap with these confs and mounted it on manila-share pod
[client.manila]
client mount uid = 0
client mount gid = 0
log file = /opt/stack/logs/ceph-client.manila.log
admin socket = /opt/stack/status/stack/ceph-$name.$pid.asok
keyring = /etc/ceph/manila.keyring

2 -> then i have created a secret with client.manila keyring and attached it to the manila-share pod at 
keyring = /etc/ceph/manila.keyring
3 -> inside manila-share pod i see the logs 

2024-06-03 09:00:53.682 6 INFO manila.share.drivers.cephfs.driver [None req-22cd7b29-a383-44cd-8cb8-1c639a3034dc - - - - - -] [CEPHFSNATIVE1] Ceph client found, connecting...
2024-06-03 09:00:53.713 6 ERROR manila.share.manager [None req-22cd7b29-a383-44cd-8cb8-1c639a3034dc - - - - - -] Error encountered during initialization of driver CephFSDriver@lab-11053-26006-ceph-2@cephfsnative1: manila.exception.ShareBackendException: [%(be)s] Ceph client failed to connect.
2024-06-03 09:00:53.713 6 ERROR manila.share.manager Traceback (most recent call last):
2024-06-03 09:00:53.713 6 ERROR manila.share.manager   File "/var/lib/openstack/lib/python3.10/site-packages/manila/share/drivers/cephfs/driver.py", line 421, in rados_client
2024-06-03 09:00:53.713 6 ERROR manila.share.manager     self._rados_client.connect()
2024-06-03 09:00:53.713 6 ERROR manila.share.manager   File "rados.pyx", line 690, in rados.Rados.connect
2024-06-03 09:00:53.713 6 ERROR manila.share.manager rados.IOError: [errno 5] RADOS I/O error (error connecting to the cluster)
2024-06-03 09:00:53.713 6 ERROR manila.share.manager
2024-06-03 09:00:53.713 6 ERROR manila.share.manager During handling of the above exception, another exception occurred:
2024-06-03 09:00:53.713 6 ERROR manila.share.manager
2024-06-03 09:00:53.713 6 ERROR manila.share.manager Traceback (most recent call last):
2024-06-03 09:00:53.713 6 ERROR manila.share.manager   File "/var/lib/openstack/lib/python3.10/site-packages/manila/share/manager.py", line 371, in _driver_setup
2024-06-03 09:00:53.713 6 ERROR manila.share.manager     self.driver.do_setup(ctxt)
2024-06-03 09:00:53.713 6 ERROR manila.share.manager   File "/var/lib/openstack/lib/python3.10/site-packages/manila/share/drivers/cephfs/driver.py", line 274, in do_setup
2024-06-03 09:00:53.713 6 ERROR manila.share.manager     rados_client=self.rados_client,
2024-06-03 09:00:53.713 6 ERROR manila.share.manager   File "/var/lib/openstack/lib/python3.10/site-packages/manila/share/drivers/cephfs/driver.py", line 424, in rados_client
2024-06-03 09:00:53.713 6 ERROR manila.share.manager     raise exception.ShareBackendException(
2024-06-03 09:00:53.713 6 ERROR manila.share.manager manila.exception.ShareBackendException: [%(be)s] Ceph client failed to connect.
2024-06-03 09:00:53.713 6 ERROR manila.share.manager
2024-06-03 09:00:53.714 6 DEBUG manila.utils [None req-22cd7b29-a383-44cd-8cb8-1c639a3034dc - - - - - -] Finished call to 'manila.share.manager.ShareManager.init_host.<locals>._driver_setup' after 2222.651(s), this was the 12th time calling it. log_it /var/lib/openstack/lib/python3.10/site-packages/tenacity/after.py:44
2024-06-03 09:00:53.714 6 DEBUG manila.utils [None req-22cd7b29-a383-44cd-8cb8-1c639a3034dc - - - - - -] Retrying manila.share.manager.ShareManager.init_host.<locals>._driver_setup in 600.0 seconds as it raised ShareBackendException: [%(be)s] Ceph client failed to connect.. log_it /var/lib/openstack/lib/python3.10/site-packages/tenacity/before_sleep.py:65


4 -> My ceph cluster is healthy

5 -> My manila confs look like (what could be wrong here)?
    conf:   
      manila:
        DEFAULT:
          debug: true
          enabled_share_protocols: NFS,CIFS,CEPHFS
          enabled_share_backends: cephfsnative1
        cephfsnative1:
          driver_handles_share_servers: False
          share_backend_name: CEPHFSNATIVE1
          share_driver: manila.share.drivers.cephfs.driver.CephFSDriver
          cephfs_conf_path: /etc/ceph/ceph.conf
          cephfs_protocol_helper_type: CEPHFS
          cephfs_auth_id: manila
          cephfs_cluster_name: rook-ceph   ( my rook-ceph cluster name)
          cephfs_filesystem_name: myfs     (i created this fs manually)
6 -> Permissions for the user manila 
ceph auth get-or-create client.manila -o manila.keyring \
  mgr 'allow rw' \
  mon 'allow r'

7 -> ceph --version
       ceph version 17.2.6 (d7ff0d10654d2280e08f1ab989c7cdf3064446a5) quincy (stable)

       openstackhelm Manila Chart
          name: manila
          version: 0.1.7

Hope to hear from you soon with a solution
Thank you!