Open Stack

On Mon, 2014-06-16 at 23:06 +0530, Deepak Shetty wrote:
> I am trying devstack on F20 setup with Manila sources.

> When i am trying to do
> manila create --name cinder_vol_share_using_nfs2 --share-network-id
> 36ec5a17-cef6-44a8-a518-457a6f36faa0 NFS 2 

> I see the below error in c-vol due to which even tho' my service VM is
> started, manila create errors out as cinder volume is not getting
> exported as iSCSI

> 2014-06-16 16:39:36.151 INFO cinder.volume.flows.manager.create_volume
> [req-15d0b435-f6ce-41cd-ae4a-3851b07cf774
> 1a7816e5f0144c539192360cdc9672d5 b65a066f32df4aca80fa9a
> 6d5c795095] Volume 8bfd424d-9877-4c20-a9d1-058c06b9bdda: being created
> as raw with specification: {'status': u'creating', 'volume_size': 2,
> 'volume_name': u'volume-8bfd
> 424d-9877-4c20-a9d1-058c06b9bdda'}
> 2014-06-16 16:39:36.151 DEBUG cinder.openstack.common.processutils
> [req-15d0b435-f6ce-41cd-ae4a-3851b07cf774
> 1a7816e5f0144c539192360cdc9672d5 b65a066f32df4aca80fa9a6d5c
> 795095] Running cmd (subprocess): sudo
> cinder-rootwrap /etc/cinder/rootwrap.conf lvcreate -n
> volume-8bfd424d-9877-4c20-a9d1-058c06b9bdda stack-volumes -L 2g from
> (pid=4
> 623)
> execute /opt/stack/cinder/cinder/openstack/common/processutils.py:142
> 2014-06-16 16:39:36.828 INFO cinder.volume.flows.manager.create_volume
> [req-15d0b435-f6ce-41cd-ae4a-3851b07cf774
> 1a7816e5f0144c539192360cdc9672d5 b65a066f32df4aca80fa9a
> 6d5c795095] Volume volume-8bfd424d-9877-4c20-a9d1-058c06b9bdda
> (8bfd424d-9877-4c20-a9d1-058c06b9bdda): created successfully
> 2014-06-16 16:39:38.404 WARNING cinder.context [-] Arguments dropped
> when creating context: {'user': u'd9bb59a6a2394483902b382a991ffea2',
> 'tenant': u'b65a066f32df4aca80
> fa9a6d5c795095', 'user_identity': u'd9bb59a6a2394483902b382a991ffea2
> b65a066f32df4aca80fa9a6d5c795095 - - -'}
> 2014-06-16 16:39:38.426 DEBUG cinder.volume.manager
> [req-083cd582-1b4d-4e7c-a70c-2c6282d8d799
> d9bb59a6a2394483902b382a991ffea2 b65a066f32df4aca80fa9a6d5c795095]
> Volume 
> 8bfd424d-9877-4c20-a9d1-058c06b9bdda: creating export from (pid=4623)
> initialize_connection /opt/stack/cinder/cinder/volume/manager.py:781
> 2014-06-16 16:39:38.428 INFO cinder.brick.iscsi.iscsi
> [req-083cd582-1b4d-4e7c-a70c-2c6282d8d799
> d9bb59a6a2394483902b382a991ffea2 b65a066f32df4aca80fa9a6d5c795095]
> Creat
> ing iscsi_target for: volume-8bfd424d-9877-4c20-a9d1-058c06b9bdda
> 2014-06-16 16:39:38.440 DEBUG cinder.brick.iscsi.iscsi
> [req-083cd582-1b4d-4e7c-a70c-2c6282d8d799
> d9bb59a6a2394483902b382a991ffea2 b65a066f32df4aca80fa9a6d5c795095]
> Crea
> ted volume
> path /opt/stack/data/cinder/volumes/volume-8bfd424d-9877-4c20-a9d1-058c06b9bdda,
> content: 
> <target
> iqn.2010-10.org.openstack:volume-8bfd424d-9877-4c20-a9d1-058c06b9bdda>
> backing-store /dev/stack-volumes/volume-8bfd424d-9877-4c20-a9d1-058c06b9bdda
> lld iscsi
> IncomingUser kZQ6rqqT7W6KGQvMZ7Lr k4qcE3G9g5z7mDWh2woe
> </target>
> from (pid=4623)
> create_iscsi_target /opt/stack/cinder/cinder/brick/iscsi/iscsi.py:183
> 2014-06-16 16:39:38.440 DEBUG cinder.openstack.common.processutils
> [req-083cd582-1b4d-4e7c-a70c-2c6282d8d799
> d9bb59a6a2394483902b382a991ffea2 b65a066f32df4aca80fa9a6d5c
> 795095] Running cmd (subprocess): sudo
> cinder-rootwrap /etc/cinder/rootwrap.conf tgt-admin --update
> iqn.2010-10.org.openstack:volume-8bfd424d-9877-4c20-a9d1-058c06b9bdd
> a from (pid=4623)
> execute /opt/stack/cinder/cinder/openstack/common/processutils.py:142
> 2014-06-16 16:39:38.981 DEBUG cinder.openstack.common.processutils
> [req-083cd582-1b4d-4e7c-a70c-2c6282d8d799
> d9bb59a6a2394483902b382a991ffea2 b65a066f32df4aca80fa9a6d5c
> 795095] Result was 107 from (pid=4623)
> execute /opt/stack/cinder/cinder/openstack/common/processutils.py:167
> 2014-06-16 16:39:38.981 WARNING cinder.brick.iscsi.iscsi
> [req-083cd582-1b4d-4e7c-a70c-2c6282d8d799
> d9bb59a6a2394483902b382a991ffea2 b65a066f32df4aca80fa9a6d5c795095] Fa
> iled to create iscsi target for volume
> id:volume-8bfd424d-9877-4c20-a9d1-058c06b9bdda: Unexpected error while
> running command.
> Command: sudo cinder-rootwrap /etc/cinder/rootwrap.conf tgt-admin
> --update
> iqn.2010-10.org.openstack:volume-8bfd424d-9877-4c20-a9d1-058c06b9bdda
> Exit code: 107
> Stdout: 'Command:\n\ttgtadm -C 0 --lld iscsi --op new --mode target
> --tid 1 -T
> iqn.2010-10.org.openstack:volume-8bfd424d-9877-4c20-a9d1-058c06b9bdda
> \nexited with code: 107.\n'
> Stderr: 'tgtadm: failed to send request hdr to tgt daemon, Transport
> endpoint is not connected\ntgtadm: failed to send request hdr to tgt
> daemon, Transport endpoint is not connected\ntgtadm: failed to send
> request hdr to tgt daemon, Transport endpoint is not connected
> \ntgtadm: failed to send request hdr to tgt daemon, Transport endpoint
> is not connected\n'
> 2014-06-16 16:39:38.982 ERROR oslo.messaging.rpc.dispatcher
> [req-083cd582-1b4d-4e7c-a70c-2c6282d8d799
> d9bb59a6a2394483902b382a991ffea2 b65a066f32df4aca80fa9a6d5c795095]
> Exception during message handling: Failed to create iscsi target for
> volume volume-8bfd424d-9877-4c20-a9d1-058c06b9bdda.
> 2014-06-16 16:39:38.982 TRACE oslo.messaging.rpc.dispatcher Traceback
> (most recent call last):
> 2014-06-16 16:39:38.982 TRACE oslo.messaging.rpc.dispatcher File
> "/usr/lib/python2.7/site-packages/oslo/messaging/rpc/dispatcher.py",
> line 134, in _dispatch_and_reply
> 2014-06-16 16:39:38.982 TRACE oslo.messaging.rpc.dispatcher
> incoming.message))
> 2014-06-16 16:39:38.982 TRACE oslo.messaging.rpc.dispatcher File
> "/usr/lib/python2.7/site-packages/oslo/messaging/rpc/dispatcher.py",
> line 177, in _dispatch
> 2014-06-16 16:39:38.982 TRACE oslo.messaging.rpc.dispatcher return
> self._do_dispatch(endpoint, method, ctxt, args)
> 2014-06-16 16:39:38.982 TRACE oslo.messaging.rpc.dispatcher File
> "/usr/lib/python2.7/site-packages/oslo/messaging/rpc/dispatcher.py",
> line 123, in _do_dispatch
> 2014-06-16 16:39:38.982 TRACE oslo.messaging.rpc.dispatcher result =
> getattr(endpoint, method)(ctxt, **new_args)
> 2014-06-16 16:39:38.982 TRACE oslo.messaging.rpc.dispatcher File
> "/opt/stack/cinder/cinder/volume/manager.py", line 783, in
> initialize_connection
> 2014-06-16 16:39:38.982 TRACE oslo.messaging.rpc.dispatcher volume)
> 2014-06-16 16:39:38.982 TRACE oslo.messaging.rpc.dispatcher File
> "/opt/stack/cinder/cinder/volume/drivers/lvm.py", line 524, in
> create_export
> 2014-06-16 16:39:38.982 TRACE oslo.messaging.rpc.dispatcher return
> self._create_export(context, volume)
> 2014-06-16 16:39:38.982 TRACE oslo.messaging.rpc.dispatcher File
> "/opt/stack/cinder/cinder/volume/drivers/lvm.py", line 533, in
> _create_export
> 2014-06-16 16:39:38.982 TRACE oslo.messaging.rpc.dispatcher data =
> self.target_helper.create_export(context, volume, volume_path)
> 2014-06-16 16:39:38.982 TRACE oslo.messaging.rpc.dispatcher File
> "/opt/stack/cinder/cinder/volume/iscsi.py", line 53, in create_export
> 2014-06-16 16:39:38.982 TRACE oslo.messaging.rpc.dispatcher chap_auth)
> 2014-06-16 16:39:38.982 TRACE oslo.messaging.rpc.dispatcher File
> "/opt/stack/cinder/cinder/brick/iscsi/iscsi.py", line 219, in
> create_iscsi_target
> 2014-06-16 16:39:38.982 TRACE oslo.messaging.rpc.dispatcher raise
> exception.ISCSITargetCreateFailed(volume_id=vol_id)
> 2014-06-16 16:39:38.982 TRACE oslo.messaging.rpc.dispatcher
> ISCSITargetCreateFailed: Failed to create iscsi target for volume
> volume-8bfd424d-9877-4c20-a9d1-058c06b9bdda.
> 2014-06-16 16:39:38.982 TRACE oslo.messaging.rpc.dispatcher 
> 2014-06-16 16:39:39.031 ERROR oslo.messaging._drivers.common
> [req-083cd582-1b4d-4e7c-a70c-2c6282d8d799
> d9bb59a6a2394483902b382a991ffea2 b65a066f32df4aca80fa9a6d5c795095]
> Returning exception Failed to create iscsi target for volume
> volume-8bfd424d-9877-4c20-a9d1-058c06b9bdda. to caller
> 2014-06-16 16:39:39.031 ERROR oslo.messaging._drivers.common
> [req-083cd582-1b4d-4e7c-a70c-2c6282d8d799
> d9bb59a6a2394483902b382a991ffea2 b65a066f32df4aca80fa9a6d5c795095]
> ['Traceback (most recent call last):\n', ' File
> "/usr/lib/python2.7/site-packages/oslo/messaging/rpc/dispatcher.py",
> line 134, in _dispatch_and_reply\n incoming.message))\n', ' File
> "/usr/lib/python2.7/site-packages/oslo/messaging/rpc/dispatcher.py",
> line 177, in _dispatch\n return self._do_dispatch(endpoint, method,
> ctxt, args)\n', ' File
> "/usr/lib/python2.7/site-packages/oslo/messaging/rpc/dispatcher.py",
> line 123, in _do_dispatch\n result = getattr(endpoint, method)(ctxt,
> **new_args)\n', ' File "/opt/stack/cinder/cinder/volume/manager.py",
> line 783, in initialize_connection\n volume)\n', ' File
> "/opt/stack/cinder/cinder/volume/drivers/lvm.py", line 524, in
> create_export\n return self._create_export(context, volume)\n', ' File
> "/opt/stack/cinder/cinder/volume/drivers/lvm.py", line 533, in
> _create_export\n data = self.target_helper.create_export(context,
> volume, volume_path)\n', ' File
> "/opt/stack/cinder/cinder/volume/iscsi.py", line 53, in create_export
> \n chap_auth)\n', ' File
> "/opt/stack/cinder/cinder/brick/iscsi/iscsi.py", line 219, in
> create_iscsi_target\n raise
> exception.ISCSITargetCreateFailed(volume_id=vol_id)\n',
> 'ISCSITargetCreateFailed: Failed to create iscsi target for volume
> volume-8bfd424d-9877-4c20-a9d1-058c06b9bdda.\n']
> 2014-06-16 16:39:40.167 WARNING cinder.context [-] Arguments dropped
> when creating context: {'user': u'd9bb59a6a2394483902b382a991ffea2',
> 'tenant': u'b65a066f32df4aca80fa9a6d5c795095', 'user_identity':
> u'd9bb59a6a2394483902b382a991ffea2 b65a066f32df4aca80fa9a6d5c795095 -
> - -'}

> Some debug info..
> [stack at devstack-large-vm ~]$ [admin] manila list --all-tenants
> +--------------------------------------+-----------------------------+------+-------------+--------+-----------------+
> |                  ID                  |             Name            |
> Size | Share Proto | Status | Export location |
> +--------------------------------------+-----------------------------+------+-------------+--------+-----------------+
> | b35518d0-20a7-4768-ba44-8f6a5b03807a |  cinder_vol_share_using_nfs |
> 2   |     NFS     | error  |       None      |
> | fb78748b-1031-4e4f-86ae-6427a3ee8c97 | cinder_vol_share_using_nfs2 |
> 2   |     NFS     | error  |       None      |
> +--------------------------------------+-----------------------------+------+-------------+--------+-----------------+

> I get the same error when trying to do the cinder-rootwrap cmd that
> otherwise is done by c-vol
> 
> +--------------------------------------+-----------------------------+------+-------------+--------+-----------------+
> [stack at devstack-large-vm ~]$ [admin] sudo
> cinder-rootwrap /etc/cinder/rootwrap.conf tgt-admin --update
> iqn.2010-10.org.openstack:volume-8bfd424d-9877-4c20-a9d1-058c06b9bdda
> tgtadm: failed to send request hdr to tgt daemon, Transport endpoint
> is not connected
> tgtadm: failed to send request hdr to tgt daemon, Transport endpoint
> is not connected
> tgtadm: failed to send request hdr to tgt daemon, Transport endpoint
> is not connected
> 
> [stack at devstack-large-vm ~]$ [admin] cinder list --all-tenants
> +--------------------------------------+-----------+---------------------------------------------------+------+-------------+----------+-------------+
> |                  ID                  |   Status  |
> Display Name                   | Size | Volume Type | Bootable |
> Attached to |
> +--------------------------------------+-----------+---------------------------------------------------+------+-------------+----------+-------------+
> | 8bfd424d-9877-4c20-a9d1-058c06b9bdda | available |
> manila-share-b35518d0-20a7-4768-ba44-8f6a5b03807a |  2   |     None
> |  false   |             |
> | af9e8c90-d2fb-4c57-884b-7234400b16cd | available |
> manila-share-fb78748b-1031-4e4f-86ae-6427a3ee8c97 |  2   |     None
> |  false   |             |
> +--------------------------------------+-----------+---------------------------------------------------+------+-------------+----------+-------------+
> 
> 
> iscsi and iscsid.service both are running in my system
> 
> [stack at devstack-large-vm ~]$ [admin] sudo systemctl status
> iscsi.service 
> iscsi.service - Login and scanning of iSCSI devices
>    Loaded: loaded (/usr/lib/systemd/system/iscsi.service; enabled)
>    Active: inactive (dead)
>            start condition failed at Mon 2014-06-16 16:01:22 UTC; 1h
> 33min ago
>            none of the trigger conditions were met
>      Docs: man:iscsid(8)
>            man:iscsiadm(8)
> 
> Jun 16 16:01:22 devstack-large-vm.localdomain systemd[1]: Started
> Login and scanning of iSCSI devices.
> [stack at devstack-large-vm ~]$ [admin] sudo systemctl status
> iscsid.service 
> iscsid.service - Open-iSCSI
>    Loaded: loaded (/usr/lib/systemd/system/iscsid.service; disabled)
>    Active: active (running) since Mon 2014-06-16 17:26:50 UTC; 8min
> ago
>      Docs: man:iscsid(8)
>            man:iscsiadm(8)
>   Process: 20236 ExecStart=/usr/sbin/iscsid (code=exited,
> status=0/SUCCESS)
>  Main PID: 20239 (iscsid)
>    CGroup: /system.slice/iscsid.service
>            ├─20238 /usr/sbin/iscsid
>            └─20239 /usr/sbin/iscsid
> 
> 
> Any hints are appreciated

From the info you've posted here it sounds like the problem is with
cinder rather than manila. Are you able to create cinder volumes and
nova instances and attach them outside of manila? If not, then you need
to fix that before trying manila w/ the generic driver. If those things
are working, then we would want to look into what manila is doing wrong.


> thanx,
> deepak
> 
> 
> _______________________________________________
> OpenStack-dev mailing list
> OpenStack-dev at lists.openstack.org
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev