Open Stack

Hi All,

I have one control, one neutron and three compute nodes for deploy. Recently, I reinstalled one of compute node's OS (Ubuntu 14.04) because a boot issue in that machine. After Ubuntu was installed, I reconfigured exactly the same as other two compute nodes to be three compute nodes. After it's up, I saw it's up state from "nova service-list" in control node. In the following nova-scheduler.log, this new installed system, compute04, has weight 1.0 and the other two compute nodes are less than 1.0. That means the new launched instance should be created in compute04. But, I don't see any qemu command is applied in compute04. The dashboard instance page shows it stuck at task "scheduling" forever after an instance is launched.  

I don't see any error logs for this issue. I also installed the VM manager app in compute04 and a VM can be created from that app. The hardware seems OK. It seems the order to launch a VM is not passed from control node to the compute node, compute04. How this issue can be debugged? Please advice. 

Thanks,
Mitchell



b/python2.7/dist-packages/nova/filters.py:88
2015-04-03 00:04:17.946 4624 DEBUG nova.filters [req-3f7d673e-ba64-46fa-b62a-943cb4a0f32e f3935a6c8c534e2d87682a9f4c763004 815104c9c1aa4908905f256df51d9ec6] Filter ImagePropertiesFilter returned 3 host(s) get_filtered_objects /usr/lib/python2.7/dist-packages/nova/filters.py:88
2015-04-03 00:04:17.965 4624 DEBUG stevedore.extension [-] found extension EntryPoint.parse('file = nova.image.download.file') _load_plugins /usr/local/lib/python2.7/dist-packages/stevedore/extension.py:156
2015-04-03 00:04:17.979 4624 ERROR stevedore.extension [-] Could not load 'file': cannot import name util
2015-04-03 00:04:17.979 4624 ERROR stevedore.extension [-] cannot import name util
2015-04-03 00:04:17.979 4624 TRACE stevedore.extension Traceback (most recent call last):
2015-04-03 00:04:17.979 4624 TRACE stevedore.extension   File "/usr/local/lib/python2.7/dist-packages/stevedore/extension.py", line 162, in _load_plugins
2015-04-03 00:04:17.979 4624 TRACE stevedore.extension     verify_requirements,
2015-04-03 00:04:17.979 4624 TRACE stevedore.extension   File "/usr/local/lib/python2.7/dist-packages/stevedore/extension.py", line 185, in _load_one_plugin
2015-04-03 00:04:17.979 4624 TRACE stevedore.extension     plugin = ep.load(require=verify_requirements)
2015-04-03 00:04:17.979 4624 TRACE stevedore.extension   File "/usr/lib/python2.7/dist-packages/pkg_resources.py", line 2088, in load
2015-04-03 00:04:17.979 4624 TRACE stevedore.extension     entry = __import__(self.module_name, globals(),globals(), ['__name__'])
2015-04-03 00:04:17.979 4624 TRACE stevedore.extension   File "/usr/lib/python2.7/dist-packages/nova/image/download/file.py", line 23, in <module>
2015-04-03 00:04:17.979 4624 TRACE stevedore.extension     import nova.virt.libvirt.utils as lv_utils
2015-04-03 00:04:17.979 4624 TRACE stevedore.extension   File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/__init__.py", line 15, in <module>
2015-04-03 00:04:17.979 4624 TRACE stevedore.extension     from nova.virt.libvirt import driver
2015-04-03 00:04:17.979 4624 TRACE stevedore.extension   File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 59, in <module>
2015-04-03 00:04:17.979 4624 TRACE stevedore.extension     from eventlet import util as eventlet_util
2015-04-03 00:04:17.979 4624 TRACE stevedore.extension ImportError: cannot import name util
2015-04-03 00:04:17.979 4624 TRACE stevedore.extension
2015-04-03 00:04:18.037 4624 DEBUG nova.filters [req-3f7d673e-ba64-46fa-b62a-943cb4a0f32e f3935a6c8c534e2d87682a9f4c763004 815104c9c1aa4908905f256df51d9ec6] Filter ServerGroupAntiAffinityFilter returned 3 host(s) get_filtered_objects /usr/lib/python2.7/dist-packages/nova/filters.py:88
2015-04-03 00:04:18.037 4624 DEBUG stevedore.extension [-] found extension EntryPoint.parse('file = nova.image.download.file') _load_plugins /usr/local/lib/python2.7/dist-packages/stevedore/extension.py:156
2015-04-03 00:04:18.040 4624 ERROR stevedore.extension [-] Could not load 'file': cannot import name util
2015-04-03 00:04:18.041 4624 ERROR stevedore.extension [-] cannot import name util
2015-04-03 00:04:18.041 4624 TRACE stevedore.extension Traceback (most recent call last):
2015-04-03 00:04:18.041 4624 TRACE stevedore.extension   File "/usr/local/lib/python2.7/dist-packages/stevedore/extension.py", line 162, in _load_plugins
2015-04-03 00:04:18.041 4624 TRACE stevedore.extension     verify_requirements,
2015-04-03 00:04:18.041 4624 TRACE stevedore.extension   File "/usr/local/lib/python2.7/dist-packages/stevedore/extension.py", line 185, in _load_one_plugin
2015-04-03 00:04:18.041 4624 TRACE stevedore.extension     plugin = ep.load(require=verify_requirements)
2015-04-03 00:04:18.041 4624 TRACE stevedore.extension   File "/usr/lib/python2.7/dist-packages/pkg_resources.py", line 2088, in load
2015-04-03 00:04:18.041 4624 TRACE stevedore.extension     entry = __import__(self.module_name, globals(),globals(), ['__name__'])
2015-04-03 00:04:18.041 4624 TRACE stevedore.extension   File "/usr/lib/python2.7/dist-packages/nova/image/download/file.py", line 23, in <module>
2015-04-03 00:04:18.041 4624 TRACE stevedore.extension     import nova.virt.libvirt.utils as lv_utils
2015-04-03 00:04:18.041 4624 TRACE stevedore.extension   File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/__init__.py", line 15, in <module>
2015-04-03 00:04:18.041 4624 TRACE stevedore.extension     from nova.virt.libvirt import driver
2015-04-03 00:04:18.041 4624 TRACE stevedore.extension   File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 59, in <module>
2015-04-03 00:04:18.041 4624 TRACE stevedore.extension     from eventlet import util as eventlet_util
2015-04-03 00:04:18.041 4624 TRACE stevedore.extension ImportError: cannot import name util
2015-04-03 00:04:18.041 4624 TRACE stevedore.extension
2015-04-03 00:04:18.043 4624 DEBUG nova.filters [req-3f7d673e-ba64-46fa-b62a-943cb4a0f32e f3935a6c8c534e2d87682a9f4c763004 815104c9c1aa4908905f256df51d9ec6] Filter ServerGroupAffinityFilter returned 3 host(s) get_filtered_objects /usr/lib/python2.7/dist-packages/nova/filters.py:88
2015-04-03 00:04:18.044 4624 DEBUG nova.scheduler.filter_scheduler [req-3f7d673e-ba64-46fa-b62a-943cb4a0f32e f3935a6c8c534e2d87682a9f4c763004 815104c9c1aa4908905f256df51d9ec6] Filtered [(compute10, compute10) ram:-2892 disk:523264 io_ops:0 instances:6, (compute04, compute04) ram:15528 disk:409600 io_ops:0 instances:3, (compute13, compute13) ram:-3335 disk:675840 io_ops:0 instances:5] _schedule /usr/lib/python2.7/dist-packages/nova/scheduler/filter_scheduler.py:332
2015-04-03 00:04:18.054 4624 DEBUG nova.scheduler.filter_scheduler [req-3f7d673e-ba64-46fa-b62a-943cb4a0f32e f3935a6c8c534e2d87682a9f4c763004 815104c9c1aa4908905f256df51d9ec6] Weighed [WeighedHost [host: compute04, weight: 1.0], WeighedHost [host: compute10, weight: 0.0234851296188], WeighedHost [host: compute13, weight: 0.0]] _schedule /usr/lib/python2.7/dist-packages/nova/scheduler/filter_scheduler.py:337
2015-04-03 00:04:18.060 4624 INFO nova.scheduler.filter_scheduler [req-3f7d673e-ba64-46fa-b62a-943cb4a0f32e f3935a6c8c534e2d87682a9f4c763004 815104c9c1aa4908905f256df51d9ec6] Choosing host WeighedHost [host: compute04, weight: 1.0] for instance 5e4f5c3e-2638-47b7-82f2-6192854de494
************* Email Confidentiality Notice ********************
The information contained in this e-mail message (including any 
attachments) may be confidential, proprietary, privileged, or otherwise
exempt from disclosure under applicable laws. It is intended to be 
conveyed only to the designated recipient(s). Any use, dissemination, 
distribution, printing, retaining or copying of this e-mail (including its 
attachments) by unintended recipient(s) is strictly prohibited and may 
be unlawful. If you are not an intended recipient of this e-mail, or believe 
that you have received this e-mail in error, please notify the sender 
immediately (by replying to this e-mail), delete any and all copies of 
this e-mail (including any attachments) from your system, and do not
disclose the content of this e-mail to any other person. Thank you!