[Openstack] Error while using VM as a compute node running KVM as hypervisor

Ravi_Sabapathy at Dell.com Ravi_Sabapathy at Dell.com
Wed Feb 10 09:11:07 UTC 2016 

Hi All,

              I was trying to bring up a VM as a compute node (using devstack kilo version and ODL version lithium) . The VM is running Ubuntu 14.04 version and it is spawned on a ESXI box and the hypervisor used is kvm. The virtualization is enabled in this VM.

mininet at ODL-CN-1-2GB:~/devstack$ cat /sys/module/kvm_intel/parameters/nested
Y
mininet at ODL-CN-1-2GB:~/devstack$

mininet at ODL-CN-1-2GB:~/devstack$ ls -l /dev/kvm
crw-rw---- 1 root kvm 10, 232 Feb 10 00:20 /dev/kvm
mininet at ODL-CN-1-2GB:~/devstack$

              After setting up the devstack with kilo version, I tried to spawn a VM from horizon and got the below error. I tried changing the libvirt_type to qemu and got the same issue. I have also attached local.conf file.

                             Error: Failed to perform requested operation on instance "VM-N1", the instance has an error status: Please try again later [Error: No valid host was found. There are not enough hosts available.].

              Detailed error:

                            Message  No valid host was found. There are not enough hosts available. No valid host was found. There are not enough hosts available.
                        Code        500
                        Details      File "/opt/stack/nova/nova/conductor/manager.py", line 671, in build_instances request_spec, filter_properties) File "/opt/stack/nova/nova/scheduler/utils.py", line 337, in wrapped return func(*args, **kwargs) File "/opt/stack/nova/nova/scheduler/client/__init__.py", line 52, in select_destinations context, request_spec, filter_properties) File "/opt/stack/nova/nova/scheduler/client/__init__.py", line 37, in __run_method return getattr(self.instance, __name)(*args, **kwargs) File "/opt/stack/nova/nova/scheduler/client/query.py", line 34, in select_destinations context, request_spec, filter_properties) File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 120, in select_destinations request_spec=request_spec, filter_properties=filter_properties) File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/client.py", line 156, in call retry=self.retry) File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/transport.py", line 90, in _send timeout=timeout, retry=retry) File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 350, in send retry=retry) File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 341, in _send raise result


            Nova scheduler error:


2016-02-09 04:29:38.982 DEBUG nova.openstack.common.periodic_task [req-7ae67d65-efa1-4193-b576-a9737c3abd89 None None] Running periodic task SchedulerManager._expire_reservations run_periodic_tasks /opt/stack/nova/nova/openstack/common/periodic_task.py:219
2016-02-09 04:29:38.993 DEBUG nova.openstack.common.loopingcall [req-7ae67d65-efa1-4193-b576-a9737c3abd89 None None] Dynamic looping call <bound method Service.periodic_tasks of <nova.service.Service object at 0x7f415e2f3910>> sleeping for 15.24 seconds _inner /opt/stack/nova/nova/openstack/common/loopingcall.py:132
2016-02-09 04:29:47.305 DEBUG nova.filters [req-ec8598d2-5a58-42ba-94bf-b6270d59a3e2 admin demo] Starting with 2 host(s) get_filtered_objects /opt/stack/nova/nova/filters.py:70
2016-02-09 04:29:47.305 DEBUG nova.filters [req-ec8598d2-5a58-42ba-94bf-b6270d59a3e2 admin demo] Filter RetryFilter returned 2 host(s) get_filtered_objects /opt/stack/nova/nova/filters.py:84
2016-02-09 04:29:47.306 DEBUG nova.scheduler.filters.availability_zone_filter [req-ec8598d2-5a58-42ba-94bf-b6270d59a3e2 admin demo] Availability Zone 'C5' requested. (nvo-PowerEdge-R620, nvo-PowerEdge-R620) ram:63806 disk:313344 io_ops:1 instances:1 has AZs: nova host_passes /opt/stack/nova/nova/scheduler/filters/availability_zone_filter.py:62
2016-02-09 04:29:47.307 DEBUG nova.filters [req-ec8598d2-5a58-42ba-94bf-b6270d59a3e2 admin demo] Filter AvailabilityZoneFilter returned 1 host(s) get_filtered_objects /opt/stack/nova/nova/filters.py:84
2016-02-09 04:29:47.307 DEBUG nova.filters [req-ec8598d2-5a58-42ba-94bf-b6270d59a3e2 admin demo] Filter RamFilter returned 1 host(s) get_filtered_objects /opt/stack/nova/nova/filters.py:84
2016-02-09 04:29:47.308 DEBUG nova.filters [req-ec8598d2-5a58-42ba-94bf-b6270d59a3e2 admin demo] Filter ComputeFilter returned 1 host(s) get_filtered_objects /opt/stack/nova/nova/filters.py:84
2016-02-09 04:29:47.308 DEBUG nova.filters [req-ec8598d2-5a58-42ba-94bf-b6270d59a3e2 admin demo] Filter ComputeCapabilitiesFilter returned 1 host(s) get_filtered_objects /opt/stack/nova/nova/filters.py:84
2016-02-09 04:29:47.309 DEBUG nova.filters [req-ec8598d2-5a58-42ba-94bf-b6270d59a3e2 admin demo] Filter ImagePropertiesFilter returned 1 host(s) get_filtered_objects /opt/stack/nova/nova/filters.py:84
2016-02-09 04:29:47.309 DEBUG nova.filters [req-ec8598d2-5a58-42ba-94bf-b6270d59a3e2 admin demo] Filter ServerGroupAntiAffinityFilter returned 1 host(s) get_filtered_objects /opt/stack/nova/nova/filters.py:84
2016-02-09 04:29:47.310 DEBUG nova.filters [req-ec8598d2-5a58-42ba-94bf-b6270d59a3e2 admin demo] Filter ServerGroupAffinityFilter returned 1 host(s) get_filtered_objects /opt/stack/nova/nova/filters.py:84
2016-02-09 04:29:47.310 DEBUG nova.scheduler.filter_scheduler [req-ec8598d2-5a58-42ba-94bf-b6270d59a3e2 admin demo] Filtered [(ODL-CN-1-2GB, ODL-CN-1-2GB) ram:1481 disk:9216 io_ops:0 instances:0] _schedule /opt/stack/nova/nova/scheduler/filter_scheduler.py:143
2016-02-09 04:29:47.311 DEBUG nova.scheduler.filter_scheduler [req-ec8598d2-5a58-42ba-94bf-b6270d59a3e2 admin demo] Weighed [WeighedHost [host: (ODL-CN-1-2GB, ODL-CN-1-2GB) ram:1481 disk:9216 io_ops:0 instances:0, weight: 0.0231877250665]] _schedule /opt/stack/nova/nova/scheduler/filter_scheduler.py:148
2016-02-09 04:29:47.311 DEBUG nova.scheduler.filter_scheduler [req-ec8598d2-5a58-42ba-94bf-b6270d59a3e2 admin demo] Selected host: WeighedHost [host: (ODL-CN-1-2GB, ODL-CN-1-2GB) ram:1481 disk:9216 io_ops:0 instances:0, weight: 0.0231877250665] _schedule /opt/stack/nova/nova/scheduler/filter_scheduler.py:158
2016-02-09 04:29:50.793 DEBUG nova.filters [req-ec8598d2-5a58-42ba-94bf-b6270d59a3e2 admin demo] Starting with 2 host(s) get_filtered_objects /opt/stack/nova/nova/filters.py:70
2016-02-09 04:29:50.794 DEBUG nova.scheduler.filters.retry_filter [req-ec8598d2-5a58-42ba-94bf-b6270d59a3e2 admin demo] Host [u'ODL-CN-1-2GB', u'ODL-CN-1-2GB'] fails.  Previously tried hosts: [[u'ODL-CN-1-2GB', u'ODL-CN-1-2GB']] host_passes /opt/stack/nova/nova/scheduler/filters/retry_filter.py:43
2016-02-09 04:29:50.794 DEBUG nova.filters [req-ec8598d2-5a58-42ba-94bf-b6270d59a3e2 admin demo] Filter RetryFilter returned 1 host(s) get_filtered_objects /opt/stack/nova/nova/filters.py:84
2016-02-09 04:29:50.794 DEBUG nova.scheduler.filters.availability_zone_filter [req-ec8598d2-5a58-42ba-94bf-b6270d59a3e2 admin demo] Availability Zone 'C5' requested. (nvo-PowerEdge-R620, nvo-PowerEdge-R620) ram:63806 disk:313344 io_ops:1 instances:1 has AZs: nova host_passes /opt/stack/nova/nova/scheduler/filters/availability_zone_filter.py:62

2016-02-09 04:29:50.795 INFO nova.filters [req-ec8598d2-5a58-42ba-94bf-b6270d59a3e2 admin demo] Filter AvailabilityZoneFilter returned 0 hosts
2016-02-09 04:29:50.795 DEBUG nova.scheduler.filter_scheduler [req-ec8598d2-5a58-42ba-94bf-b6270d59a3e2 admin demo] There are 0 hosts available but 1 instances requested to build. select_destinations /opt/stack/nova/nova/scheduler/filter_scheduler.py:77

2016-02-09 04:29:54.230 DEBUG nova.openstack.common.periodic_task [req-7ae67d65-efa1-4193-b576-a9737c3abd89 None None] Running periodic task SchedulerManager._run_periodic_tasks run_periodic_tasks /opt/stack/nova/nova/openstack/common/periodic_task.py:219
2016-02-09 04:29:54.231 DEBUG nova.openstack.common.loopingcall [req-7ae67d65-efa1-4193-b576-a9737c3abd89 None None] Dynamic looping call <bound method Service.periodic_tasks of <nova.service.Service object at 0x7f415e2f3910>> sleeping for 44.75 seconds _inner /opt/stack/nova/nova/openstack/common/loopingcall.py:132
2016-02-09 04:29:58.998 DEBUG oslo_concurrency.lockutils [req-6dc8e1ab-0a04-482d-9b3c-7b875e390d3d None None] Lock "host_instance" acquired by "sync_instance_info" :: waited 0.000s inner /usr/local/lib/python2.7/dist-packages/oslo_concurrency/lockutils.py:444
2016-02-09 04:29:58.999 INFO nova.scheduler.host_manager [req-6dc8e1ab-0a04-482d-9b3c-7b875e390d3d None None] Successfully synced instances from host 'nvo-PowerEdge-R620'.
2016-02-09 04:29:59.000 DEBUG oslo_concurrency.lockutils [req-6dc8e1ab-0a04-482d-9b3c-7b875e390d3d None None] Lock "host_instance" released by "sync_instance_info" :: held 0.001s inner /usr/local/lib/python2.7/dist-packages/oslo_concurrency/lockutils.py:456


2016-02-09 04:30:33.518 DEBUG oslo_concurrency.lockutils [req-ce05dcb4-81eb-4920-be8e-46698e6efb3d None None] Lock "host_instance" acquired by "sync_instance_info" :: waited 0.000s inner /usr/local/lib/python2.7/dist-packages/oslo_concurrency/lockutils.py:444
2016-02-09 04:30:33.550 INFO nova.scheduler.host_manager [req-ce05dcb4-81eb-4920-be8e-46698e6efb3d None None] The instance sync for host 'ODL-CN-1-2GB' did not match. Re-created its InstanceList.
2016-02-09 04:30:33.551 DEBUG oslo_concurrency.lockutils [req-ce05dcb4-81eb-4920-be8e-46698e6efb3d None None] Lock "host_instance" released by "sync_instance_info" :: held 0.033s inner /usr/local/lib/python2.7/dist-packages/oslo_concurrency/lockutils.py:456
2016-02-09 04:30:37.116 DEBUG oslo_concurrency.lockutils [req-8e6ae75e-c0b0-43aa-a61b-d125fbbf559e None None] Lock "host_instance" acquired by "sync_instance_info" :: waited 0.000s inner /usr/local/lib/python2.7/dist-packages/oslo_concurrency/lockutils.py:444
2016-02-09 04:30:37.117 INFO nova.scheduler.host_manager [req-8e6ae75e-c0b0-43aa-a61b-d125fbbf559e None None] Successfully synced instances from host 'ODL-CN-2-3GB'.
2016-02-09 04:30:37.117 DEBUG oslo_concurrency.lockutils [req-8e6ae75e-c0b0-43aa-a61b-d125fbbf559e None None] Lock "host_instance" released by "sync_instance_info" :: held 0.001s inner /usr/local/lib/python2.7/dist-packages/oslo_concurrency/lockutils.py:456
2016-02-09 04:30:38.982 DEBUG nova.openstack.common.periodic_task [req-7ae67d65-efa1-4193-b576-a9737c3abd89 None None] Running periodic task SchedulerManager._expire_reservations run_periodic_tasks /opt/stack/nova/nova/openstack/common/periodic_task.py:219
2016-02-09 04:30:38.998 DEBUG nova.openstack.common.loopingcall [req-7ae67d65-efa1-4193-b576-a9737c3abd89 None None] Dynamic looping call <bound method Service.periodic_tasks of <nova.service.Service object at 0x7f415e2f3910>> sleeping for 15.23 seconds _inner /opt/stack/nova/nova/openstack/common/loopingcall.py:132+


              Can anyone help me resolve this issue?

Software used:

              Devstack                                                        kilo version
              ODL                                                                Lithium
              Openvswitch                                                2.3.1
              Compute node VM OS version                 Ubuntu 14.04
              Hypervisor                                                    kvm




Regards,
Ravi
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack/attachments/20160210/37272c76/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: local.conf
Type: application/octet-stream
Size: 1481 bytes
Desc: local.conf
URL: <http://lists.openstack.org/pipermail/openstack/attachments/20160210/37272c76/attachment.obj>

More information about the Openstack mailing list