[manila][kolla-ansible] Fail to use manila with cephfs NFS share backend

Boxiang Zhu bxzhu_5355 at 163.com
Mon Nov 11 03:33:54 UTC 2019



Hi everyone,


I have deployed a OpenStack cluster with AIO mode by kolla-ansible.
In my globals.yml, something is enabled as followed:
    ......
    enable_ceph: "yes"
    enable_ceph_mds: "yes"
    enable_ceph_nfs: "yes"
    enable_manila: "yes"
    enable_manila_backend_cephfs_nfs: "yes"
    .......
And in my manila.conf, some configs are as followed:
    [DEFAULT]
    enabled_share_protocols = NFS,CIFS
    ......
    [cephfsnfs1]
    driver_handles_share_servers = False
    share_backend_name = CEPHFSNFS1
    share_driver = manila.share.drivers.cephfs.driver.CephFSDriver
    cephfs_protocol_helper_type = NFS
    cephfs_conf_path = /etc/ceph/ceph.conf
    cephfs_auth_id = manila
    cephfs_cluster_name = ceph
    cephfs_enable_snapshots = False
    cephfs_ganesha_server_is_remote = False
    cephfs_ganesha_server_ip = 172.16.60.84
    ......
I use CLI to create the nfs, some commands as followed:
    -> manila type-create cephfsnfstype false
    -> manila type-key cephfsnfstype set vendor_name=Ceph storage_protocol=NFS
    -> manila create --share-type cephfsnfstype --name cephnfsshare1 nfs 1
    -> manila share-export-location-list cephnfsshare1
    +-----------------------------------------------+------------------------------------------------------------------------------------+-----------+
    | ID                                                                   | Path                                                                                                                    | Preferred |
    +-----------------------------------------------+------------------------------------------------------------------------------------+-----------+
    | b101bf59-4cd7-4a09-a12e-b6dd48a5bb18 | 172.16.60.84:/volumes/_nogroup/93b1e23d-0166-41a4-a12a-51bf4c3654a5 | False        |
    +-----------------------------------------------+------------------------------------------------------------------------------------+-----------+
    -> manila access-allow cephnfsshare1 ip 172.16.60.119
But I have got some error messages from /var/lib/docker/volumes/kolla_logs/_data/manila/manila-share.log
2019-11-11 10:11:12.035 26 ERROR manila.share.drivers.ganesha.manager [req-673584f9-eaed-4464-819e-ace63dfa0f49 6f4bd93b18c546c880d5d4e526a0243e 70dba7786a8b4326a35e03d0ad8707f2 - - -] Error while executing management command on Ganesha node <no name>: dbus call exportmgr.AddExport.: ProcessExecutionError: Unexpected error while running command.
2019-11-11 10:11:14.954 26 ERROR oslo_messaging.rpc.server [req-673584f9-eaed-4464-819e-ace63dfa0f49 6f4bd93b18c546c880d5d4e526a0243e 70dba7786a8b4326a35e03d0ad8707f2 - - -] Exception during message handling: GaneshaCommandFailure: Ganesha management command failed.
Command: sudo manila-rootwrap /etc/manila/rootwrap.conf dbus-send --print-reply --system --dest=org.ganesha.nfsd /org/ganesha/nfsd/ExportMgr org.ganesha.nfsd.exportmgr.AddExport string:/etc/ganesha/export.d/share-93b1e23d-0166-41a4-a12a-51bf4c3654a5.conf string:EXPORT(Export_Id=105)
Exit code: 1
Stdout: u''
Stderr: u'Error org.freedesktop.DBus.Error.ServiceUnknown: The name org.ganesha.nfsd was not provided by any .service files\n'
2019-11-11 10:11:14.954 26 ERROR oslo_messaging.rpc.server Traceback (most recent call last):
2019-11-11 10:11:14.954 26 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
2019-11-11 10:11:14.954 26 ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
2019-11-11 10:11:14.954 26 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 274, in dispatch
2019-11-11 10:11:14.954 26 ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
2019-11-11 10:11:14.954 26 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 194, in _do_dispatch
2019-11-11 10:11:14.954 26 ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
2019-11-11 10:11:14.954 26 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python2.7/site-packages/manila/share/manager.py", line 187, in wrapped
2019-11-11 10:11:14.954 26 ERROR oslo_messaging.rpc.server     return f(self, *args, **kwargs)
2019-11-11 10:11:14.954 26 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python2.7/site-packages/manila/utils.py", line 568, in wrapper
2019-11-11 10:11:14.954 26 ERROR oslo_messaging.rpc.server     return func(self, *args, **kwargs)
2019-11-11 10:11:14.954 26 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python2.7/site-packages/manila/share/manager.py", line 3554, in update_access
2019-11-11 10:11:14.954 26 ERROR oslo_messaging.rpc.server     share_server=share_server)
2019-11-11 10:11:14.954 26 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python2.7/site-packages/manila/share/access.py", line 283, in update_access_rules
2019-11-11 10:11:14.954 26 ERROR oslo_messaging.rpc.server     share_server=share_server)
2019-11-11 10:11:14.954 26 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python2.7/site-packages/manila/share/access.py", line 322, in _update_access_rules
2019-11-11 10:11:14.954 26 ERROR oslo_messaging.rpc.server     share_server)
2019-11-11 10:11:14.954 26 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python2.7/site-packages/manila/share/access.py", line 390, in _update_rules_through_share_driver
2019-11-11 10:11:14.954 26 ERROR oslo_messaging.rpc.server     share_server=share_server
2019-11-11 10:11:14.954 26 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python2.7/site-packages/manila/share/drivers/cephfs/driver.py", line 289, in update_access
2019-11-11 10:11:14.954 26 ERROR oslo_messaging.rpc.server     share_server=share_server)
2019-11-11 10:11:14.954 26 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python2.7/site-packages/manila/share/drivers/ganesha/__init__.py", line 308, in update_access
2019-11-11 10:11:14.954 26 ERROR oslo_messaging.rpc.server     self.ganesha.add_export(share['name'], confdict)
2019-11-11 10:11:14.954 26 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python2.7/site-packages/manila/share/drivers/ganesha/manager.py", line 491, in add_export
2019-11-11 10:11:14.954 26 ERROR oslo_messaging.rpc.server     cmd=e.cmd)
2019-11-11 10:11:14.954 26 ERROR oslo_messaging.rpc.server GaneshaCommandFailure: Ganesha management command failed.
2019-11-11 10:11:14.954 26 ERROR oslo_messaging.rpc.server Command: sudo manila-rootwrap /etc/manila/rootwrap.conf dbus-send --print-reply --system --dest=org.ganesha.nfsd /org/ganesha/nfsd/ExportMgr org.ganesha.nfsd.exportmgr.AddExport string:/etc/ganesha/export.d/share-93b1e23d-0166-41a4-a12a-51bf4c3654a5.conf string:EXPORT(Export_Id=105)
2019-11-11 10:11:14.954 26 ERROR oslo_messaging.rpc.server Exit code: 1
2019-11-11 10:11:14.954 26 ERROR oslo_messaging.rpc.server Stdout: u''
2019-11-11 10:11:14.954 26 ERROR oslo_messaging.rpc.server Stderr: u'Error org.freedesktop.DBus.Error.ServiceUnknown: The name org.ganesha.nfsd was not provided by any .service files\n'
2019-11-11 10:11:14.954 26 ERROR oslo_messaging.rpc.server


    I found some possible solutions[0][1][2][3] to try to fix this, but failed.
    Any suggestions?


[0] https://github.com/nfs-ganesha/nfs-ganesha/issues/483
[1] https://github.com/nfs-ganesha/nfs-ganesha/issues/219
[2] https://github.com/gluster/storhaug/issues/14
[3] https://sourceforge.net/p/nfs-ganesha/mailman/message/32227132/


Thanks,
Boxiang





-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-discuss/attachments/20191111/a42e2ded/attachment-0001.html>


More information about the openstack-discuss mailing list