Open Stack

Some more trouble shooting on this (and still no progress) I see this when I reboot (or use targetcli which is below this log):


[root at block1 Python-2014-09-30-15:11:51-7481]# more backtrace
node.py:60:_create_in_cfs_ine:RTSLibError: Could not create NetworkPortal in configFS.

Traceback (most recent call last):
  File "/bin/cinder-rtstool", line 238, in <module>
    sys.exit(main())
  File "/bin/cinder-rtstool", line 203, in main
    create(backing_device, name, userid, password, initiator_iqns)
  File "/bin/cinder-rtstool", line 95, in create
    rtslib.NetworkPortal(tpg_new, '0.0.0.0', 3260, mode='any')
  File "/usr/lib/python2.7/site-packages/rtslib/target.py", line 694, in __init__
    self._create_in_cfs_ine(mode)
  File "/usr/lib/python2.7/site-packages/rtslib/node.py", line 60, in _create_in_cfs_ine
    % self.__class__.__name__)
RTSLibError: Could not create NetworkPortal in configFS.

Local variables in innermost frame:
self: <NetworkPortal 0.0.0.0 port 3260>
mode: 'any'


FROM targetcli:

/iscsi/iqn.20.../tpg1/portals> ls
o- portals ............................................................................................................ [Portals: 0]
/iscsi/iqn.20.../tpg1/portals> create ip_address=10.7.5.41
Using default IP port 3260
Could not create NetworkPortal in configFS.



On Tuesday, October 7, 2014 11:07 AM, Amit Anand <mr_amitanand at yahoo.com> wrote:
 


Hi all,

Been troubleshooting this for a while now and cant seem to figure out what wrong, reaching out here hoping that maybe someone would have some input/advice on how to fix. I am trying to add a volume to an instance and it keeps failing with the following errors below. Would appreciate any insight as I am wits end and I apologize in advance if this is not a place to ask questions such as these - Ive tried the AskOpenstack and have gotten nothing. Thanks!!

[root at block1 tgt]# cinder list
+--------------------------------------+-----------+--------------+------+-------------+----------+-------------+
|                  ID                  |   Status  | Display Name | Size | Volume Type | Bootable | Attached to |
+--------------------------------------+-----------+--------------+------+-------------+----------+-------------+
| 4c6e1b15-2c7e-4bca-aae4-925cc054db8d | available |   myVolume   |  1   |     None    |  false   |             |
| b8df2a1a-48df-443c-a078-bec907d8462d | available |   amitvol    |  20  |     None    |  false   |             |
+--------------------------------------+-----------+--------------+------+-------------+----------+-------------+



Block node error log:

2014-10-07 10:58:46.720 31375 ERROR cinder.brick.iscsi.iscsi [req-d5e26671-6ca3-45d8-a9ca-730913c87010 8748be7fb9d544c088a7192137422231    bb7ce560d1e9482b862679cefaf5ae69 - - -] Failed to create iscsi target for volume id:volume-b8df2a1a-48df-443c-a078-bec907d8462d.

2014-10-07 10:58:46.721 31375 ERROR cinder.brick.iscsi.iscsi [req-d5e26671-6ca3-45d8-a9ca-730913c87010 8748be7fb9d544c088a7192137422231    bb7ce560d1e9482b862679cefaf5ae69 - - -] Unexpected error while running command.
Command: sudo cinder-rootwrap /etc/cinder/rootwrap.conf cinder-rtstool create /dev/cinder-volumes/volume-b8df2a1a-48df-443c-a078-bec907   d8462d iqn.2010-10.org.openstack:volume-b8df2a1a-48df-443c-a078-bec907d8462d 8HayuR8mAq7QpK9y7soB iZypk62NhziXmfvdZMDf
Exit code: 1
Stdout: 'Error creating NetworkPortal: ensure port 3260 is not in use by another service.\n'
Stderr: 'Traceback (most recent call last):\n  File "/bin/cinder-rtstool", line 238, in <module>\n    sys.exit(main())\n  File "/bin/ci   nder-rtstool", line 203, in main\n    create(backing_device, name, userid, password, initiator_iqns)\n  File "/bin/cinder-rtstool", lin   e 95, in create\n    rtslib.NetworkPortal(tpg_new, \'0.0.0.0\', 3260, mode=\'any\')\n  File "/usr/lib/python2.7/site-packages/rtslib/ta   rget.py", line 694, in __init__\n    self._create_in_cfs_ine(mode)\n  File "/usr/lib/python2.7/site-packages/rtslib/node.py", line 60,    in _create_in_cfs_ine\n    % self.__class__.__name__)\nrtslib.utils.RTSLibError: Could not create NetworkPortal in configFS.\n'

2014-10-07 10:58:46.721 31375 ERROR oslo.messaging.rpc.dispatcher [req-d5e26671-6ca3-45d8-a9ca-730913c87010 8748be7fb9d544c088a71921374   22231 bb7ce560d1e9482b862679cefaf5ae69 - - -] Exception during message handling: Failed to create iscsi target for volume volume-b8df2a   1a-48df-443c-a078-bec907d8462d.

2014-10-07 10:58:46.721 31375 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/site-packages/cinder/brick/iscsi/iscsi.py"   , line 540, in create_iscsi_target

2014-10-07 10:58:46.721 31375 TRACE oslo.messaging.rpc.dispatcher     raise exception.ISCSITargetCreateFailed(volume_id=vol_id)

2014-10-07 10:58:46.721 31375 TRACE oslo.messaging.rpc.dispatcher ISCSITargetCreateFailed: Failed to create iscsi target for volume vol   ume-b8df2a1a-48df-443c-a078-bec907d8462d.

2014-10-07 10:58:46.721 31375 TRACE oslo.messaging.rpc.dispatcher

2014-10-07 10:58:46.724 31375 ERROR oslo.messaging._drivers.common [req-d5e26671-6ca3-45d8-a9ca-730913c87010 8748be7fb9d544c088a7192137   422231 bb7ce560d1e9482b862679cefaf5ae69 - - -] Returning exception Failed to create iscsi target for volume volume-b8df2a1a-48df-443c-a   078-bec907d8462d. to caller

2014-10-07 10:58:46.724 31375 ERROR oslo.messaging._drivers.common [req-d5e26671-6ca3-45d8-a9ca-730913c87010 8748be7fb9d544c088a7192137   422231 bb7ce560d1e9482b862679cefaf5ae69 - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/site-packages/oslo/   messaging/rpc/dispatcher.py", line 133, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/site-packages/os   lo/messaging/rpc/dispatcher.py", line 176, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/l   ib/python2.7/site-packages/oslo/messaging/rpc/dispatcher.py", line 122, in _do_dispatch\n    result = getattr(endpoint, method)(ctxt, *   *new_args)\n', '  File "/usr/lib/python2.7/site-packages/cinder/volume/manager.py", line 783, in initialize_connection\n    volume)\n',    '  File "/usr/lib/python2.7/site-packages/cinder/volume/drivers/lvm.py", line 524, in create_export\n    return self._create_export(co  
 ntext, volume)\n', '  File "/usr/lib/python2.7/site-packages/cinder/volume/drivers/lvm.py", line 533, in _create_export\n    data = sel   f.target_helper.create_export(context, volume, volume_path)\n', '  File "/usr/lib/python2.7/site-packages/cinder/volume/iscsi.py", line    53, in create_export\n    chap_auth)\n', '  File "/usr/lib/python2.7/site-packages/cinder/brick/iscsi/iscsi.py", line 540, in create_i   scsi_target\n    raise exception.ISCSITargetCreateFailed(volume_id=vol_id)\n', 'ISCSITargetCreateFailed: Failed to create iscsi target    for volume volume-b8df2a1a-48df-443c-a078-bec907d8462d.\n']


Controller node error log:

2014-10-07 10:58:46.745 12232 ERROR cinder.api.middleware.fault [req-d5e26671-6ca3-45d8-a9ca-730913c87010 8748be7fb9d544c088a7192137422231 bb7ce560d1e9482b862679cefaf5ae69 - - -] Caught error: Remote error: ISCSITargetCreateFailed Failed to create iscsi target for volume volume-b8df2a1a-48df-443c-a078-bec907d8462d.
[u'Traceback (most recent call last):\n', u'  File "/usr/lib/python2.7/site-packages/oslo/messaging/rpc/dispatcher.py", line 133, in _dispatch_and_reply\n    incoming.message))\n', u'  File "/usr/lib/python2.7/site-packages/oslo/messaging/rpc/dispatcher.py", line 176, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', u'  File "/usr/lib/python2.7/site-packages/oslo/messaging/rpc/dispatcher.py", line 122, in _do_dispatch\n    result = getattr(endpoint, method)(ctxt, **new_args)\n', u'  File "/usr/lib/python2.7/site-packages/cinder/volume/manager.py", line 783, in initialize_connection\n    volume)\n', u'  File "/usr/lib/python2.7/site-packages/cinder/volume/drivers/lvm.py", line 524, in create_export\n    return self._create_export(context, volume)\n', u'  File "/usr/lib/python2.7/site-packages/cinder/volume/drivers/lvm.py", line 533, in _create_export\n    data = self.target_helper.create_export(context, volume, volume_path)\n',
 u'  File "/usr/lib/python2.7/site-packages/cinder/volume/iscsi.py", line 53, in create_export\n    chap_auth)\n', u'  File "/usr/lib/python2.7/site-packages/cinder/brick/iscsi/iscsi.py", line 540, in create_iscsi_target\n    raise exception.ISCSITargetCreateFailed(volume_id=vol_id)\n', u'ISCSITargetCreateFailed: Failed to create iscsi target for volume volume-b8df2a1a-48df-443c-a078-bec907d8462d.\n'].


2014-10-07 10:58:46.745 12232 TRACE cinder.api.middleware.fault RemoteError: Remote error: ISCSITargetCreateFailed Failed to create iscsi target for volume volume-b8df2a1a-48df-443c-a078-bec907d8462d.

2014-10-07 10:58:46.745 12232 TRACE cinder.api.middleware.fault [u'Traceback (most recent call last):\n', u'  File "/usr/lib/python2.7/site-packages/oslo/messaging/rpc/dispatcher.py", line 133, in _dispatch_and_reply\n    incoming.message))\n', u'  File "/usr/lib/python2.7/site-packages/oslo/messaging/rpc/dispatcher.py", line 176, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', u'  File "/usr/lib/python2.7/site-packages/oslo/messaging/rpc/dispatcher.py", line 122, in _do_dispatch\n    result = getattr(endpoint, method)(ctxt, **new_args)\n', u'  File "/usr/lib/python2.7/site-packages/cinder/volume/manager.py", line 783, in initialize_connection\n    volume)\n', u'  File "/usr/lib/python2.7/site-packages/cinder/volume/drivers/lvm.py", line 524, in create_export\n    return self._create_export(context, volume)\n', u'  File "/usr/lib/python2.7/site-packages/cinder/volume/drivers/lvm.py", line 533, in _create_export\n    data =
 self.target_helper.create_export(context, volume, volume_path)\n', u'  File "/usr/lib/python2.7/site-packages/cinder/volume/iscsi.py", line 53, in create_export\n    chap_auth)\n', u'  File "/usr/lib/python2.7/site-packages/cinder/brick/iscsi/iscsi.py", line 540, in create_iscsi_target\n    raise exception.ISCSITargetCreateFailed(volume_id=vol_id)\n', u'ISCSITargetCreateFailed: Failed to create iscsi target for volume volume-b8df2a1a-48df-443c-a078-bec907d8462d.\n'].
2014-10-07 10:58:46.745 12232 TRACE cinder.api.middleware.fault
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack/attachments/20141015/08e237d5/attachment.html>