[manila][kolla-ansible] Fail to use manila with cephfs NFS share backend
Radosław Piliszek
radoslaw.piliszek at gmail.com
Mon Nov 11 08:43:41 UTC 2019
Is this Stein on CentOS?
Looks like a bug to me.
Please report to: https://bugs.launchpad.net/kolla-ansible
with all the details we ask for. Thanks.
-yoctozepto
pon., 11 lis 2019 o 04:45 Boxiang Zhu <bxzhu_5355 at 163.com> napisał(a):
>
> Hi everyone,
>
> I have deployed a OpenStack cluster with AIO mode by kolla-ansible.
> In my globals.yml, something is enabled as followed:
> ......
> enable_ceph: "yes"
> enable_ceph_mds: "yes"
> enable_ceph_nfs: "yes"
> enable_manila: "yes"
> enable_manila_backend_cephfs_nfs: "yes"
> .......
> And in my manila.conf, some configs are as followed:
> [DEFAULT]
> enabled_share_protocols = NFS,CIFS
> ......
> [cephfsnfs1]
> driver_handles_share_servers = False
> share_backend_name = CEPHFSNFS1
> share_driver = manila.share.drivers.cephfs.driver.CephFSDriver
> cephfs_protocol_helper_type = NFS
> cephfs_conf_path = /etc/ceph/ceph.conf
> cephfs_auth_id = manila
> cephfs_cluster_name = ceph
> cephfs_enable_snapshots = False
> cephfs_ganesha_server_is_remote = False
> cephfs_ganesha_server_ip = 172.16.60.84
> ......
> I use CLI to create the nfs, some commands as followed:
> -> manila type-create cephfsnfstype false
> -> manila type-key cephfsnfstype set vendor_name=Ceph
> storage_protocol=NFS
> -> manila create --share-type cephfsnfstype --name cephnfsshare1 nfs 1
> -> manila share-export-location-list cephnfsshare1
>
> +-----------------------------------------------+------------------------------------------------------------------------------------+-----------+
> | ID
> | Path
> | Preferred |
>
> +-----------------------------------------------+------------------------------------------------------------------------------------+-----------+
> | b101bf59-4cd7-4a09-a12e-b6dd48a5bb18 | 172.16.60.84:/volumes/_nogroup/93b1e23d-0166-41a4-a12a-51bf4c3654a5
> | False |
>
> +-----------------------------------------------+------------------------------------------------------------------------------------+-----------+
> -> manila access-allow cephnfsshare1 ip 172.16.60.119
> But I have got some error messages
> from /var/lib/docker/volumes/kolla_logs/_data/manila/manila-share.log
> 2019-11-11 10:11:12.035 26 ERROR manila.share.drivers.ganesha.manager
> [req-673584f9-eaed-4464-819e-ace63dfa0f49 6f4bd93b18c546c880d5d4e526a0243e
> 70dba7786a8b4326a35e03d0ad8707f2 - - -] Error while executing management
> command on Ganesha node <no name>: dbus call exportmgr.AddExport.:
> ProcessExecutionError: Unexpected error while running command.
> 2019-11-11 10:11:14.954 26 ERROR oslo_messaging.rpc.server
> [req-673584f9-eaed-4464-819e-ace63dfa0f49 6f4bd93b18c546c880d5d4e526a0243e
> 70dba7786a8b4326a35e03d0ad8707f2 - - -] Exception during message handling:
> GaneshaCommandFailure: Ganesha management command failed.
> Command: sudo manila-rootwrap /etc/manila/rootwrap.conf dbus-send
> --print-reply --system --dest=org.ganesha.nfsd /org/ganesha/nfsd/ExportMgr
> org.ganesha.nfsd.exportmgr.AddExport
> string:/etc/ganesha/export.d/share-93b1e23d-0166-41a4-a12a-51bf4c3654a5.conf
> string:EXPORT(Export_Id=105)
> Exit code: 1
> Stdout: u''
> Stderr: u'Error org.freedesktop.DBus.Error.ServiceUnknown: The name
> org.ganesha.nfsd was not provided by any .service files\n'
> 2019-11-11 10:11:14.954 26 ERROR oslo_messaging.rpc.server Traceback (most
> recent call last):
> 2019-11-11 10:11:14.954 26 ERROR oslo_messaging.rpc.server File
> "/var/lib/kolla/venv/lib/python2.7/site-packages/oslo_messaging/rpc/server.py",
> line 165, in _process_incoming
> 2019-11-11 10:11:14.954 26 ERROR oslo_messaging.rpc.server res =
> self.dispatcher.dispatch(message)
> 2019-11-11 10:11:14.954 26 ERROR oslo_messaging.rpc.server File
> "/var/lib/kolla/venv/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py",
> line 274, in dispatch
> 2019-11-11 10:11:14.954 26 ERROR oslo_messaging.rpc.server return
> self._do_dispatch(endpoint, method, ctxt, args)
> 2019-11-11 10:11:14.954 26 ERROR oslo_messaging.rpc.server File
> "/var/lib/kolla/venv/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py",
> line 194, in _do_dispatch
> 2019-11-11 10:11:14.954 26 ERROR oslo_messaging.rpc.server result =
> func(ctxt, **new_args)
> 2019-11-11 10:11:14.954 26 ERROR oslo_messaging.rpc.server File
> "/var/lib/kolla/venv/lib/python2.7/site-packages/manila/share/manager.py",
> line 187, in wrapped
> 2019-11-11 10:11:14.954 26 ERROR oslo_messaging.rpc.server return
> f(self, *args, **kwargs)
> 2019-11-11 10:11:14.954 26 ERROR oslo_messaging.rpc.server File
> "/var/lib/kolla/venv/lib/python2.7/site-packages/manila/utils.py", line
> 568, in wrapper
> 2019-11-11 10:11:14.954 26 ERROR oslo_messaging.rpc.server return
> func(self, *args, **kwargs)
> 2019-11-11 10:11:14.954 26 ERROR oslo_messaging.rpc.server File
> "/var/lib/kolla/venv/lib/python2.7/site-packages/manila/share/manager.py",
> line 3554, in update_access
> 2019-11-11 10:11:14.954 26 ERROR oslo_messaging.rpc.server
> share_server=share_server)
> 2019-11-11 10:11:14.954 26 ERROR oslo_messaging.rpc.server File
> "/var/lib/kolla/venv/lib/python2.7/site-packages/manila/share/access.py",
> line 283, in update_access_rules
> 2019-11-11 10:11:14.954 26 ERROR oslo_messaging.rpc.server
> share_server=share_server)
> 2019-11-11 10:11:14.954 26 ERROR oslo_messaging.rpc.server File
> "/var/lib/kolla/venv/lib/python2.7/site-packages/manila/share/access.py",
> line 322, in _update_access_rules
> 2019-11-11 10:11:14.954 26 ERROR oslo_messaging.rpc.server
> share_server)
> 2019-11-11 10:11:14.954 26 ERROR oslo_messaging.rpc.server File
> "/var/lib/kolla/venv/lib/python2.7/site-packages/manila/share/access.py",
> line 390, in _update_rules_through_share_driver
> 2019-11-11 10:11:14.954 26 ERROR oslo_messaging.rpc.server
> share_server=share_server
> 2019-11-11 10:11:14.954 26 ERROR oslo_messaging.rpc.server File
> "/var/lib/kolla/venv/lib/python2.7/site-packages/manila/share/drivers/cephfs/driver.py",
> line 289, in update_access
> 2019-11-11 10:11:14.954 26 ERROR oslo_messaging.rpc.server
> share_server=share_server)
> 2019-11-11 10:11:14.954 26 ERROR oslo_messaging.rpc.server File
> "/var/lib/kolla/venv/lib/python2.7/site-packages/manila/share/drivers/ganesha/__init__.py",
> line 308, in update_access
> 2019-11-11 10:11:14.954 26 ERROR oslo_messaging.rpc.server
> self.ganesha.add_export(share['name'], confdict)
> 2019-11-11 10:11:14.954 26 ERROR oslo_messaging.rpc.server File
> "/var/lib/kolla/venv/lib/python2.7/site-packages/manila/share/drivers/ganesha/manager.py",
> line 491, in add_export
> 2019-11-11 10:11:14.954 26 ERROR oslo_messaging.rpc.server cmd=e.cmd)
> 2019-11-11 10:11:14.954 26 ERROR oslo_messaging.rpc.server
> GaneshaCommandFailure: Ganesha management command failed.
> 2019-11-11 10:11:14.954 26 ERROR oslo_messaging.rpc.server Command: sudo
> manila-rootwrap /etc/manila/rootwrap.conf dbus-send --print-reply --system
> --dest=org.ganesha.nfsd /org/ganesha/nfsd/ExportMgr
> org.ganesha.nfsd.exportmgr.AddExport
> string:/etc/ganesha/export.d/share-93b1e23d-0166-41a4-a12a-51bf4c3654a5.conf
> string:EXPORT(Export_Id=105)
> 2019-11-11 10:11:14.954 26 ERROR oslo_messaging.rpc.server Exit code: 1
> 2019-11-11 10:11:14.954 26 ERROR oslo_messaging.rpc.server Stdout: u''
> 2019-11-11 10:11:14.954 26 ERROR oslo_messaging.rpc.server Stderr: u'Error
> org.freedesktop.DBus.Error.ServiceUnknown: The name org.ganesha.nfsd was
> not provided by any .service files\n'
> 2019-11-11 10:11:14.954 26 ERROR oslo_messaging.rpc.server
>
> I found some possible solutions[0][1][2][3] to try to fix this, but
> failed.
> Any suggestions?
>
> [0] https://github.com/nfs-ganesha/nfs-ganesha/issues/483
> [1] https://github.com/nfs-ganesha/nfs-ganesha/issues/219
> [2] https://github.com/gluster/storhaug/issues/14
> [3] https://sourceforge.net/p/nfs-ganesha/mailman/message/32227132/
>
> Thanks,
> Boxiang
>
>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-discuss/attachments/20191111/453ac0bc/attachment-0001.html>
More information about the openstack-discuss
mailing list