[openstack-dev] Can not create cinder volume

Johnson Cheng Johnson.Cheng at QsanTechnology.com
Tue Jul 15 07:24:20 UTC 2014 

Dear All,

Update again.
I have already solved the half issue.

Here is my environment,

l   Two machines: controller node & compute node (service node)

l   Cinder-api & cinder-schedule are installed at controller node

l   Cinder-volume is installed at both controller node and compute node

Here is the output of my “cinder-manage host list” command,
host                            zone
controller                      nova
Compute                         nova

First I marked two lines in cinder.conf because I have not install ceilometers component,
#control_exchange = cinder
#notification_driver = cinder.openstack.common.notifier.rpc_notifier
Second I corrected rabbit configuration in cinder.conf at compute node.
Now I can successfully create cinder volume from controller node, and the volume will be created at compute node.

Unfortunately, when I shutdown compute node, I still can NOT create a cinder volume at controller node.
Here is my cinder-volume.log,
2014-07-15 15:01:58.906 13901 AUDIT cinder.service [-] Starting cinder-volume node (version 2014.1)
2014-07-15 15:01:58.912 13901 INFO cinder.volume.manager [req-bebf157a-53db-47da-8b54-0e8a4d898b61 - - - - -] Starting volume driver LVMISCSIDriver (2.0.0)
2014-07-15 15:01:59.146 13901 ERROR cinder.volume.manager [req-bebf157a-53db-47da-8b54-0e8a4d898b61 - - - - -] Error encountered during initialization of driver: LVMISCSIDriver
2014-07-15 15:01:59.147 13901 ERROR cinder.volume.manager [req-bebf157a-53db-47da-8b54-0e8a4d898b61 - - - - -] Unexpected error while running command.
Command: sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name cinder-volumes
Exit code: 1
Stdout: ''
Stderr: 'Traceback (most recent call last):\n  File "/usr/bin/cinder-rootwrap", line 10, in <module>\n    sys.exit(main())\n  File "/usr/lib/python2.7/dist-packages/oslo/rootwrap/cmd.py", line 107, in main\n    filters = wrapper.load_filters(config.filters_path)\n  File "/usr/lib/python2.7/dist-packages/oslo/rootwrap/wrapper.py", line 119, in load_filters\n    for (name, value) in filterconfig.items("Filters"):\n  File "/usr/lib/python2.7/ConfigParser.py", line 347, in items\n    raise NoSectionError(section)\nConfigParser.NoSectionError: No section: \'Filters\'\n'
2014-07-15 15:01:59.147 13901 TRACE cinder.volume.manager Traceback (most recent call last):
2014-07-15 15:01:59.147 13901 TRACE cinder.volume.manager   File "/usr/lib/python2.7/dist-packages/cinder/volume/manager.py", line 243, in init_host
2014-07-15 15:01:59.147 13901 TRACE cinder.volume.manager     self.driver.check_for_setup_error()
2014-07-15 15:01:59.147 13901 TRACE cinder.volume.manager   File "/usr/lib/python2.7/dist-packages/cinder/volume/drivers/lvm.py", line 83, in check_for_setup_error
2014-07-15 15:01:59.147 13901 TRACE cinder.volume.manager     executor=self._execute)
2014-07-15 15:01:59.147 13901 TRACE cinder.volume.manager   File "/usr/lib/python2.7/dist-packages/cinder/brick/local_dev/lvm.py", line 81, in __init__
2014-07-15 15:01:59.147 13901 TRACE cinder.volume.manager     if self._vg_exists() is False:
2014-07-15 15:01:59.147 13901 TRACE cinder.volume.manager   File "/usr/lib/python2.7/dist-packages/cinder/brick/local_dev/lvm.py", line 106, in _vg_exists
2014-07-15 15:01:59.147 13901 TRACE cinder.volume.manager     self.vg_name, root_helper=self._root_helper, run_as_root=True)
2014-07-15 15:01:59.147 13901 TRACE cinder.volume.manager   File "/usr/lib/python2.7/dist-packages/cinder/utils.py", line 136, in execute
2014-07-15 15:01:59.147 13901 TRACE cinder.volume.manager     return processutils.execute(*cmd, **kwargs)
2014-07-15 15:01:59.147 13901 TRACE cinder.volume.manager   File "/usr/lib/python2.7/dist-packages/cinder/openstack/common/processutils.py", line 173, in execute
2014-07-15 15:01:59.147 13901 TRACE cinder.volume.manager     cmd=' '.join(cmd))
2014-07-15 15:01:59.147 13901 TRACE cinder.volume.manager ProcessExecutionError: Unexpected error while running command.
2014-07-15 15:01:59.147 13901 TRACE cinder.volume.manager Command: sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name cinder-volumes
2014-07-15 15:01:59.147 13901 TRACE cinder.volume.manager Exit code: 1
2014-07-15 15:01:59.147 13901 TRACE cinder.volume.manager Stdout: ''
2014-07-15 15:01:59.147 13901 TRACE cinder.volume.manager Stderr: 'Traceback (most recent call last):\n  File "/usr/bin/cinder-rootwrap", line 10, in <module>\n    sys.exit(main())\n  File "/usr/lib/python2.7/dist-packages/oslo/rootwrap/cmd.py", line 107, in main\n    filters = wrapper.load_filters(config.filters_path)\n  File "/usr/lib/python2.7/dist-packages/oslo/rootwrap/wrapper.py", line 119, in load_filters\n    for (name, value) in filterconfig.items("Filters"):\n  File "/usr/lib/python2.7/ConfigParser.py", line 347, in items\n    raise NoSectionError(section)\nConfigParser.NoSectionError: No section: \'Filters\'\n'
2014-07-15 15:01:59.147 13901 TRACE cinder.volume.manager
2014-07-15 15:01:59.938 13901 INFO oslo.messaging._drivers.impl_rabbit [-] Connected to AMQP server on controller:5672
2014-07-15 15:02:43.962 13901 INFO cinder.volume.manager [req-4fdfc0f3-6dde-4648-a603-be8cfdfc362f - - - - -] Updating volume status
2014-07-15 15:02:43.964 13901 WARNING cinder.volume.manager [req-4fdfc0f3-6dde-4648-a603-be8cfdfc362f - - - - -] Unable to update stats, LVMISCSIDriver -2.0.0  driver is uninitialized.
2014-07-15 15:03:43.961 13901 INFO cinder.volume.manager [-] Updating volume status
2014-07-15 15:03:43.962 13901 WARNING cinder.volume.manager [-] Unable to update stats, LVMISCSIDriver -2.0.0  driver is uninitialized.
2014-07-15 15:04:43.964 13901 INFO cinder.volume.manager [-] Updating volume status
2014-07-15 15:04:43.965 13901 WARNING cinder.volume.manager [-] Unable to update stats, LVMISCSIDriver -2.0.0  driver is uninitialized.

Here is my cinder-scheduler.log,
2014-07-15 15:01:44.348 7395 INFO cinder.openstack.common.service [-] Caught SIGTERM, exiting
2014-07-15 15:01:45.673 13654 AUDIT cinder.service [-] Starting cinder-scheduler node (version 2014.1)
2014-07-15 15:01:45.723 13654 INFO oslo.messaging._drivers.impl_rabbit [req-36d9d1ca-7aad-4a6c-af92-8d1db9308eb0 - - - - -] Connected to AMQP server on controller:5672
2014-07-15 15:01:46.570 13654 INFO oslo.messaging._drivers.impl_rabbit [-] Connected to AMQP server on controller:5672
2014-07-15 15:06:38.915 13654 WARNING cinder.context [-] Arguments dropped when creating context: {'user': u'1149275f4ea84690a9da5b7f442ab48f', 'tenant': u'4e898758e77c4d3c8d0b0eecf5ae0957', 'user_identity': u'1149275f4ea84690a9da5b7f442ab48f 4e898758e77c4d3c8d0b0eecf5ae0957 - - -'}
2014-07-15 15:06:39.114 13654 WARNING cinder.scheduler.host_manager [req-a788cfb9-fc36-41c2-bc5e-5adfa64b9223 1149275f4ea84690a9da5b7f442ab48f 4e898758e77c4d3c8d0b0eecf5ae0957 - - -] volume service is down or disabled. (host: Compute)
2014-07-15 15:06:39.116 13654 ERROR cinder.scheduler.filters.capacity_filter [req-a788cfb9-fc36-41c2-bc5e-5adfa64b9223 1149275f4ea84690a9da5b7f442ab48f 4e898758e77c4d3c8d0b0eecf5ae0957 - - -] Free capacity not set: volume node info collection broken.
2014-07-15 15:06:39.119 13654 ERROR cinder.scheduler.flows.create_volume [req-a788cfb9-fc36-41c2-bc5e-5adfa64b9223 1149275f4ea84690a9da5b7f442ab48f 4e898758e77c4d3c8d0b0eecf5ae0957 - - -] Failed to schedule_create_volume: No valid host was found.

I have two questions here,

1.      It still has “Error encountered during initialization of driver: LVMISCSIDriver” error message in cinder-volume.log, how to fix this issue?

2.      From cinder-scheduler.log, it shows “volume service is down or disabled. (host: Compute)”. How can I modify cinder.conf to create cinder volume at controller node?

Regards,
Johnson



From: Johnson Cheng [mailto:Johnson.Cheng at QsanTechnology.com]
Sent: Tuesday, July 15, 2014 11:01 AM
To: OpenStack Development Mailing List (not for usage questions)
Subject: Re: [openstack-dev] Can not create cinder volume

Hi,

Here is my complete cinder-volume.log
2014-07-15 10:55:28.849 27399 AUDIT cinder.service [-] Starting cinder-volume node (version 2014.1)
2014-07-15 10:55:28.862 27399 INFO cinder.volume.manager [req-06b5b19c-20b2-4e8d-a675-b4ef51ebe3a6 - - - - -] Starting volume driver LVMISCSIDriver (2.0.0)
2014-07-15 10:55:29.985 27399 ERROR cinder.volume.manager [req-06b5b19c-20b2-4e8d-a675-b4ef51ebe3a6 - - - - -] Error encountered during initialization of driver: LVMISCSIDriver
2014-07-15 10:55:29.986 27399 ERROR cinder.volume.manager [req-06b5b19c-20b2-4e8d-a675-b4ef51ebe3a6 - - - - -] Unexpected error while running command.
Command: sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name cinder-volumes
Exit code: 1
Stdout: ''
Stderr: 'Traceback (most recent call last):\n  File "/usr/bin/cinder-rootwrap", line 10, in <module>\n    sys.exit(main())\n  File "/usr/lib/python2.7/dist-packages/oslo/rootwrap/cmd.py", line 107, in main\n    filters = wrapper.load_filters(config.filters_path)\n  File "/usr/lib/python2.7/dist-packages/oslo/rootwrap/wrapper.py", line 119, in load_filters\n    for (name, value) in filterconfig.items("Filters"):\n  File "/usr/lib/python2.7/ConfigParser.py", line 347, in items\n    raise NoSectionError(section)\nConfigParser.NoSectionError: No section: \'Filters\'\n'
2014-07-15 10:55:29.986 27399 TRACE cinder.volume.manager Traceback (most recent call last):
2014-07-15 10:55:29.986 27399 TRACE cinder.volume.manager   File "/usr/lib/python2.7/dist-packages/cinder/volume/manager.py", line 243, in init_host
2014-07-15 10:55:29.986 27399 TRACE cinder.volume.manager     self.driver.check_for_setup_error()
2014-07-15 10:55:29.986 27399 TRACE cinder.volume.manager   File "/usr/lib/python2.7/dist-packages/cinder/volume/drivers/lvm.py", line 83, in check_for_setup_error
2014-07-15 10:55:29.986 27399 TRACE cinder.volume.manager     executor=self._execute)
2014-07-15 10:55:29.986 27399 TRACE cinder.volume.manager   File "/usr/lib/python2.7/dist-packages/cinder/brick/local_dev/lvm.py", line 81, in __init__
2014-07-15 10:55:29.986 27399 TRACE cinder.volume.manager     if self._vg_exists() is False:
2014-07-15 10:55:29.986 27399 TRACE cinder.volume.manager   File "/usr/lib/python2.7/dist-packages/cinder/brick/local_dev/lvm.py", line 106, in _vg_exists
2014-07-15 10:55:29.986 27399 TRACE cinder.volume.manager     self.vg_name, root_helper=self._root_helper, run_as_root=True)
2014-07-15 10:55:29.986 27399 TRACE cinder.volume.manager   File "/usr/lib/python2.7/dist-packages/cinder/utils.py", line 136, in execute
2014-07-15 10:55:29.986 27399 TRACE cinder.volume.manager     return processutils.execute(*cmd, **kwargs)
2014-07-15 10:55:29.986 27399 TRACE cinder.volume.manager   File "/usr/lib/python2.7/dist-packages/cinder/openstack/common/processutils.py", line 173, in execute
2014-07-15 10:55:29.986 27399 TRACE cinder.volume.manager     cmd=' '.join(cmd))
2014-07-15 10:55:29.986 27399 TRACE cinder.volume.manager ProcessExecutionError: Unexpected error while running command.
2014-07-15 10:55:29.986 27399 TRACE cinder.volume.manager Command: sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name cinder-volumes
2014-07-15 10:55:29.986 27399 TRACE cinder.volume.manager Exit code: 1
2014-07-15 10:55:29.986 27399 TRACE cinder.volume.manager Stdout: ''
2014-07-15 10:55:29.986 27399 TRACE cinder.volume.manager Stderr: 'Traceback (most recent call last):\n  File "/usr/bin/cinder-rootwrap", line 10, in <module>\n    sys.exit(main())\n  File "/usr/lib/python2.7/dist-packages/oslo/rootwrap/cmd.py", line 107, in main\n    filters = wrapper.load_filters(config.filters_path)\n  File "/usr/lib/python2.7/dist-packages/oslo/rootwrap/wrapper.py", line 119, in load_filters\n    for (name, value) in filterconfig.items("Filters"):\n  File "/usr/lib/python2.7/ConfigParser.py", line 347, in items\n    raise NoSectionError(section)\nConfigParser.NoSectionError: No section: \'Filters\'\n'
2014-07-15 10:55:29.986 27399 TRACE cinder.volume.manager
2014-07-15 10:55:30.909 27399 INFO oslo.messaging._drivers.impl_rabbit [-] Connected to AMQP server on controller:5672
2014-07-15 10:55:49.942 27399 INFO cinder.volume.manager [req-2e368031-ee15-428d-8239-2973261f116d - - - - -] Updating volume status
2014-07-15 10:55:49.943 27399 WARNING cinder.volume.manager [req-2e368031-ee15-428d-8239-2973261f116d - - - - -] Unable to update stats, LVMISCSIDriver -2.0.0  driver is uninitialized.

My cinder version is 1.0.8, and “cinder service-list” output is listed as below,
+------------------+------------+------+---------+-------+----------------------------+
|      Binary      |    Host    | Zone |  Status | State |         Updated_at         |
+------------------+------------+------+---------+-------+----------------------------+
| cinder-scheduler | controller | nova | enabled |   up  | 2014-07-15T02:57:55.000000 |
|  cinder-volume   | controller | nova | enabled |   up  | 2014-07-15T02:57:51.000000 |
+------------------+------------+------+---------+-------+----------------------------+


Regards,
Johnson


From: John Griffith [mailto:john.griffith at solidfire.com]
Sent: Monday, July 14, 2014 10:26 PM
To: OpenStack Development Mailing List (not for usage questions)
Subject: Re: [openstack-dev] Can not create cinder volume



On Mon, Jul 14, 2014 at 8:13 AM, Duncan Thomas <duncan.thomas at gmail.com<mailto:duncan.thomas at gmail.com>> wrote:
Please post up more (all) of your cinder-volume.log - something is stopping your driver being initialised, but you haven't provided enough logs to tell what the issue it.

On 14 July 2014 12:22, Johnson Cheng <Johnson.Cheng at qsantechnology.com<mailto:Johnson.Cheng at qsantechnology.com>> wrote:
Dear All,

When I use “cinder create –display-name myVolume 1” to create a cinder volume, its status will be error when I use “cinder list” to query it.
+--------------------------------------+--------+--------------+------+-------------+----------+-------------+
|                  ID                  | Status | Display Name | Size | Volume Type | Bootable | Attached to |
+--------------------------------------+--------+--------------+------+-------------+----------+-------------+
| 83059a3e-e66c-4fd8-829e-09ca450b4d70 | error  |   myVolume   |  1   |     None    |  false   |             |
















My Openstack version is Icehouse, and I install it on Ubuntu 14.04 LTS.

The vgs output,
  VG                #PV #LV #SN Attr   VSize   VFree
  cinder-volumes      1   0   0 wz--n- 153.38g 153.38g

Here is my cinder.conf
[DEFAULT]
rootwrap_config = /etc/cinder/rootwrap.conf
api_paste_confg = /etc/cinder/api-paste.ini
iscsi_helper = tgtadm
volume_name_template = volume-%s
volume_group = cinder-volumes
verbose = True
auth_strategy = keystone
state_path = /var/lib/cinder
lock_path = /var/lock/cinder
volumes_dir = /var/lib/cinder/volumes

rpc_backend = cinder.openstack.common.rpc.impl_kombu
rabbit_host = controller
rabbit_port = 5672
rabbit_userid = guest
rabbit_password = demo

glance_host = controller

control_exchange = cinder
notification_driver = cinder.openstack.common.notifier.rpc_notifier

[database]
connection = mysql://cinder:demo@controller/cinder

[keystone_authtoken]
auth_uri = http://controller:5000
auth_host = controller
auth_port = 35357
auth_protocol = http
admin_tenant_name = service
admin_user = cinder
admin_password = demo

Here is my cinder-schedule.log
2014-07-14 17:34:37.592 7141 INFO oslo.messaging._drivers.impl_rabbit [-] Connected to AMQP server on controller:5672
2014-07-14 17:34:44.769 7141 WARNING cinder.context [-] Arguments dropped when creating context: {'user': u'1149275f4ea84690a9da5b7f442ab48f', 'tenant': u'4e898758e77c4d3c8d0b0eecf5ae0957', 'user_identity': u'1149275f4ea84690a9da5b7f442ab48f 4e898758e77c4d3c8d0b0eecf5ae0957 - - -'}
2014-07-14 17:34:45.004 7141 ERROR cinder.scheduler.filters.capacity_filter [req-ebae9974-8741-4a6d-af44-456e506e5612 1149275f4ea84690a9da5b7f442ab48f 4e898758e77c4d3c8d0b0eecf5ae0957 - - -] Free capacity not set: volume node info collection broken.
2014-07-14 17:34:45.030 7141 ERROR cinder.scheduler.flows.create_volume [req-ebae9974-8741-4a6d-af44-456e506e5612 1149275f4ea84690a9da5b7f442ab48f 4e898758e77c4d3c8d0b0eecf5ae0957 - - -] Failed to schedule_create_volume: No valid host was found.

Here is my cinder-volume.log
2014-07-14 19:14:15.489 7151 INFO cinder.volume.manager [-] Updating volume status
2014-07-14 19:14:15.490 7151 WARNING cinder.volume.manager [-] Unable to update stats, LVMISCSIDriver -2.0.0  driver is uninitialized.


Your response will be appreciated.
Let me know if you need more information.


Regards,
Johnson


_______________________________________________
OpenStack-dev mailing list
OpenStack-dev at lists.openstack.org<mailto:OpenStack-dev at lists.openstack.org>
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev



--
Duncan Thomas

_______________________________________________
OpenStack-dev mailing list
OpenStack-dev at lists.openstack.org<mailto:OpenStack-dev at lists.openstack.org>
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
​Make sure "controller" resolves on your cinder-volume node.  It appears that either your volume-node isn't able to communicate with the controller (you can check this by trying a 'cinder service-list').  Another possibility is something's not quite right with your message queue settings.  Main thing here would again be name resolution and that your message queue is actually matched up here (ie settings on the controller match those on your volume-node).



-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-dev/attachments/20140715/35527bef/attachment.html>

More information about the OpenStack-dev mailing list