[Openstack] Error while using VM as a compute node running KVM as hypervisor
Andreas Scheuring
scheuran at linux.vnet.ibm.com
Wed Feb 10 09:52:44 UTC 2016
Seems like it found a host to schedule it on (ODL-CN-1-2GB)
Selected host: WeighedHost [host: (ODL-CN-1-2GB, ODL-CN-1-2GB) ram:1481
disk:9216 io_ops:0 instances:0, weight: 0.0231877250665]
_schedule /opt/stack/nova/nova/scheduler/filter_scheduler.py:158
But launching that instance on this host failed for some reason. That's
why the scheduler tries to schedule it to another
host(nvo-PowerEdge-R620) which is not in the requested availability
zone.
You should focus your error search on the first host that was selected,
but couldn't launch the instance. Good places to start are
- the nova-cpu log
- the neutron agent log
of your hot ODL-CN1-2GB.. Typically one of those agents has an error
message with more details...
--
-----
Andreas (IRC: scheuran)
On Mi, 2016-02-10 at 14:41 +0530, Ravi_Sabapathy at Dell.com wrote:
> Hi All,
>
>
>
> I was trying to bring up a VM as a compute node (using
> devstack kilo version and ODL version lithium) . The VM is running
> Ubuntu 14.04 version and it is spawned on a ESXI box and the
> hypervisor used is kvm. The virtualization is enabled in this VM.
>
>
>
> mininet at ODL-CN-1-2GB:~/devstack$
> cat /sys/module/kvm_intel/parameters/nested
>
> Y
>
> mininet at ODL-CN-1-2GB:~/devstack$
>
>
>
> mininet at ODL-CN-1-2GB:~/devstack$ ls -l /dev/kvm
>
> crw-rw---- 1 root kvm 10, 232 Feb 10 00:20 /dev/kvm
>
> mininet at ODL-CN-1-2GB:~/devstack$
>
>
>
> After setting up the devstack with kilo version, I tried
> to spawn a VM from horizon and got the below error. I tried changing
> the libvirt_type to qemu and got the same issue. I have also attached
> local.conf file.
>
>
>
> Error: Failed to perform requested
> operation on instance "VM-N1", the instance has an error status:
> Please try again later [Error: No valid host was found. There are not
> enough hosts available.].
>
>
>
> Detailed error:
>
>
>
> Message No valid host was found. There
> are not enough hosts available. No valid host was found. There are not
> enough hosts available.
>
> Code 500
>
> Details File
> "/opt/stack/nova/nova/conductor/manager.py", line 671, in
> build_instances request_spec, filter_properties) File
> "/opt/stack/nova/nova/scheduler/utils.py", line 337, in wrapped return
> func(*args, **kwargs) File
> "/opt/stack/nova/nova/scheduler/client/__init__.py", line 52, in
> select_destinations context, request_spec, filter_properties) File
> "/opt/stack/nova/nova/scheduler/client/__init__.py", line 37, in
> __run_method return getattr(self.instance, __name)(*args, **kwargs)
> File "/opt/stack/nova/nova/scheduler/client/query.py", line 34, in
> select_destinations context, request_spec, filter_properties) File
> "/opt/stack/nova/nova/scheduler/rpcapi.py", line 120, in
> select_destinations request_spec=request_spec,
> filter_properties=filter_properties) File
> "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/client.py",
> line 156, in call retry=self.retry) File
> "/usr/local/lib/python2.7/dist-packages/oslo_messaging/transport.py",
> line 90, in _send timeout=timeout, retry=retry) File
> "/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 350, in send retry=retry) File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 341, in _send raise result
>
>
>
>
>
> Nova scheduler error:
>
>
>
>
>
> 2016-02-09 04:29:38.982 DEBUG nova.openstack.common.periodic_task
> [req-7ae67d65-efa1-4193-b576-a9737c3abd89 None None] Running periodic
> task SchedulerManager._expire_reservations
> run_periodic_tasks /opt/stack/nova/nova/openstack/common/periodic_task.py:219
>
> 2016-02-09 04:29:38.993 DEBUG nova.openstack.common.loopingcall
> [req-7ae67d65-efa1-4193-b576-a9737c3abd89 None None] Dynamic looping
> call <bound method Service.periodic_tasks of <nova.service.Service
> object at 0x7f415e2f3910>> sleeping for 15.24 seconds
> _inner /opt/stack/nova/nova/openstack/common/loopingcall.py:132
>
> 2016-02-09 04:29:47.305 DEBUG nova.filters
> [req-ec8598d2-5a58-42ba-94bf-b6270d59a3e2 admin demo] Starting with 2
> host(s) get_filtered_objects /opt/stack/nova/nova/filters.py:70
>
> 2016-02-09 04:29:47.305 DEBUG nova.filters
> [req-ec8598d2-5a58-42ba-94bf-b6270d59a3e2 admin demo] Filter
> RetryFilter returned 2 host(s)
> get_filtered_objects /opt/stack/nova/nova/filters.py:84
>
> 2016-02-09 04:29:47.306 DEBUG
> nova.scheduler.filters.availability_zone_filter
> [req-ec8598d2-5a58-42ba-94bf-b6270d59a3e2 admin demo] Availability
> Zone 'C5' requested. (nvo-PowerEdge-R620, nvo-PowerEdge-R620)
> ram:63806 disk:313344 io_ops:1 instances:1 has AZs: nova
> host_passes /opt/stack/nova/nova/scheduler/filters/availability_zone_filter.py:62
>
> 2016-02-09 04:29:47.307 DEBUG nova.filters
> [req-ec8598d2-5a58-42ba-94bf-b6270d59a3e2 admin demo] Filter
> AvailabilityZoneFilter returned 1 host(s)
> get_filtered_objects /opt/stack/nova/nova/filters.py:84
>
> 2016-02-09 04:29:47.307 DEBUG nova.filters
> [req-ec8598d2-5a58-42ba-94bf-b6270d59a3e2 admin demo] Filter RamFilter
> returned 1 host(s)
> get_filtered_objects /opt/stack/nova/nova/filters.py:84
>
> 2016-02-09 04:29:47.308 DEBUG nova.filters
> [req-ec8598d2-5a58-42ba-94bf-b6270d59a3e2 admin demo] Filter
> ComputeFilter returned 1 host(s)
> get_filtered_objects /opt/stack/nova/nova/filters.py:84
>
> 2016-02-09 04:29:47.308 DEBUG nova.filters
> [req-ec8598d2-5a58-42ba-94bf-b6270d59a3e2 admin demo] Filter
> ComputeCapabilitiesFilter returned 1 host(s)
> get_filtered_objects /opt/stack/nova/nova/filters.py:84
>
> 2016-02-09 04:29:47.309 DEBUG nova.filters
> [req-ec8598d2-5a58-42ba-94bf-b6270d59a3e2 admin demo] Filter
> ImagePropertiesFilter returned 1 host(s)
> get_filtered_objects /opt/stack/nova/nova/filters.py:84
>
> 2016-02-09 04:29:47.309 DEBUG nova.filters
> [req-ec8598d2-5a58-42ba-94bf-b6270d59a3e2 admin demo] Filter
> ServerGroupAntiAffinityFilter returned 1 host(s)
> get_filtered_objects /opt/stack/nova/nova/filters.py:84
>
> 2016-02-09 04:29:47.310 DEBUG nova.filters
> [req-ec8598d2-5a58-42ba-94bf-b6270d59a3e2 admin demo] Filter
> ServerGroupAffinityFilter returned 1 host(s)
> get_filtered_objects /opt/stack/nova/nova/filters.py:84
>
> 2016-02-09 04:29:47.310 DEBUG nova.scheduler.filter_scheduler
> [req-ec8598d2-5a58-42ba-94bf-b6270d59a3e2 admin demo] Filtered
> [(ODL-CN-1-2GB, ODL-CN-1-2GB) ram:1481 disk:9216 io_ops:0 instances:0]
> _schedule /opt/stack/nova/nova/scheduler/filter_scheduler.py:143
>
> 2016-02-09 04:29:47.311 DEBUG nova.scheduler.filter_scheduler
> [req-ec8598d2-5a58-42ba-94bf-b6270d59a3e2 admin demo] Weighed
> [WeighedHost [host: (ODL-CN-1-2GB, ODL-CN-1-2GB) ram:1481 disk:9216
> io_ops:0 instances:0, weight: 0.0231877250665]]
> _schedule /opt/stack/nova/nova/scheduler/filter_scheduler.py:148
>
> 2016-02-09 04:29:47.311 DEBUG nova.scheduler.filter_scheduler
> [req-ec8598d2-5a58-42ba-94bf-b6270d59a3e2 admin demo] Selected host:
> WeighedHost [host: (ODL-CN-1-2GB, ODL-CN-1-2GB) ram:1481 disk:9216
> io_ops:0 instances:0, weight: 0.0231877250665]
> _schedule /opt/stack/nova/nova/scheduler/filter_scheduler.py:158
>
> 2016-02-09 04:29:50.793 DEBUG nova.filters
> [req-ec8598d2-5a58-42ba-94bf-b6270d59a3e2 admin demo] Starting with 2
> host(s) get_filtered_objects /opt/stack/nova/nova/filters.py:70
>
> 2016-02-09 04:29:50.794 DEBUG nova.scheduler.filters.retry_filter
> [req-ec8598d2-5a58-42ba-94bf-b6270d59a3e2 admin demo] Host
> [u'ODL-CN-1-2GB', u'ODL-CN-1-2GB'] fails. Previously tried hosts:
> [[u'ODL-CN-1-2GB', u'ODL-CN-1-2GB']]
> host_passes /opt/stack/nova/nova/scheduler/filters/retry_filter.py:43
>
> 2016-02-09 04:29:50.794 DEBUG nova.filters
> [req-ec8598d2-5a58-42ba-94bf-b6270d59a3e2 admin demo] Filter
> RetryFilter returned 1 host(s)
> get_filtered_objects /opt/stack/nova/nova/filters.py:84
>
> 2016-02-09 04:29:50.794 DEBUG
> nova.scheduler.filters.availability_zone_filter
> [req-ec8598d2-5a58-42ba-94bf-b6270d59a3e2 admin demo] Availability
> Zone 'C5' requested. (nvo-PowerEdge-R620, nvo-PowerEdge-R620)
> ram:63806 disk:313344 io_ops:1 instances:1 has AZs: nova
> host_passes /opt/stack/nova/nova/scheduler/filters/availability_zone_filter.py:62
>
>
>
> 2016-02-09 04:29:50.795 INFO nova.filters
> [req-ec8598d2-5a58-42ba-94bf-b6270d59a3e2 admin demo] Filter
> AvailabilityZoneFilter returned 0 hosts
>
> 2016-02-09 04:29:50.795 DEBUG nova.scheduler.filter_scheduler
> [req-ec8598d2-5a58-42ba-94bf-b6270d59a3e2 admin demo] There are 0
> hosts available but 1 instances requested to build.
> select_destinations /opt/stack/nova/nova/scheduler/filter_scheduler.py:77
>
>
>
> 2016-02-09 04:29:54.230 DEBUG nova.openstack.common.periodic_task
> [req-7ae67d65-efa1-4193-b576-a9737c3abd89 None None] Running periodic
> task SchedulerManager._run_periodic_tasks
> run_periodic_tasks /opt/stack/nova/nova/openstack/common/periodic_task.py:219
>
> 2016-02-09 04:29:54.231 DEBUG nova.openstack.common.loopingcall
> [req-7ae67d65-efa1-4193-b576-a9737c3abd89 None None] Dynamic looping
> call <bound method Service.periodic_tasks of <nova.service.Service
> object at 0x7f415e2f3910>> sleeping for 44.75 seconds
> _inner /opt/stack/nova/nova/openstack/common/loopingcall.py:132
>
> 2016-02-09 04:29:58.998 DEBUG oslo_concurrency.lockutils
> [req-6dc8e1ab-0a04-482d-9b3c-7b875e390d3d None None] Lock
> "host_instance" acquired by "sync_instance_info" :: waited 0.000s
> inner /usr/local/lib/python2.7/dist-packages/oslo_concurrency/lockutils.py:444
>
> 2016-02-09 04:29:58.999 INFO nova.scheduler.host_manager
> [req-6dc8e1ab-0a04-482d-9b3c-7b875e390d3d None None] Successfully
> synced instances from host 'nvo-PowerEdge-R620'.
>
> 2016-02-09 04:29:59.000 DEBUG oslo_concurrency.lockutils
> [req-6dc8e1ab-0a04-482d-9b3c-7b875e390d3d None None] Lock
> "host_instance" released by "sync_instance_info" :: held 0.001s
> inner /usr/local/lib/python2.7/dist-packages/oslo_concurrency/lockutils.py:456
>
>
>
>
>
> 2016-02-09 04:30:33.518 DEBUG oslo_concurrency.lockutils
> [req-ce05dcb4-81eb-4920-be8e-46698e6efb3d None None] Lock
> "host_instance" acquired by "sync_instance_info" :: waited 0.000s
> inner /usr/local/lib/python2.7/dist-packages/oslo_concurrency/lockutils.py:444
>
> 2016-02-09 04:30:33.550 INFO nova.scheduler.host_manager
> [req-ce05dcb4-81eb-4920-be8e-46698e6efb3d None None] The instance sync
> for host 'ODL-CN-1-2GB' did not match. Re-created its InstanceList.
>
> 2016-02-09 04:30:33.551 DEBUG oslo_concurrency.lockutils
> [req-ce05dcb4-81eb-4920-be8e-46698e6efb3d None None] Lock
> "host_instance" released by "sync_instance_info" :: held 0.033s
> inner /usr/local/lib/python2.7/dist-packages/oslo_concurrency/lockutils.py:456
>
> 2016-02-09 04:30:37.116 DEBUG oslo_concurrency.lockutils
> [req-8e6ae75e-c0b0-43aa-a61b-d125fbbf559e None None] Lock
> "host_instance" acquired by "sync_instance_info" :: waited 0.000s
> inner /usr/local/lib/python2.7/dist-packages/oslo_concurrency/lockutils.py:444
>
> 2016-02-09 04:30:37.117 INFO nova.scheduler.host_manager
> [req-8e6ae75e-c0b0-43aa-a61b-d125fbbf559e None None] Successfully
> synced instances from host 'ODL-CN-2-3GB'.
>
> 2016-02-09 04:30:37.117 DEBUG oslo_concurrency.lockutils
> [req-8e6ae75e-c0b0-43aa-a61b-d125fbbf559e None None] Lock
> "host_instance" released by "sync_instance_info" :: held 0.001s
> inner /usr/local/lib/python2.7/dist-packages/oslo_concurrency/lockutils.py:456
>
> 2016-02-09 04:30:38.982 DEBUG nova.openstack.common.periodic_task
> [req-7ae67d65-efa1-4193-b576-a9737c3abd89 None None] Running periodic
> task SchedulerManager._expire_reservations
> run_periodic_tasks /opt/stack/nova/nova/openstack/common/periodic_task.py:219
>
> 2016-02-09 04:30:38.998 DEBUG nova.openstack.common.loopingcall
> [req-7ae67d65-efa1-4193-b576-a9737c3abd89 None None] Dynamic looping
> call <bound method Service.periodic_tasks of <nova.service.Service
> object at 0x7f415e2f3910>> sleeping for 15.23 seconds
> _inner /opt/stack/nova/nova/openstack/common/loopingcall.py:132+
>
>
>
>
>
> Can anyone help me resolve this issue?
>
>
>
> Software used:
>
>
>
> Devstack
> kilo version
>
> ODL
> Lithium
>
> Openvswitch
> 2.3.1
>
> Compute node VM OS version Ubuntu 14.04
>
> Hypervisor
> kvm
>
>
>
>
>
>
>
>
>
> Regards,
>
> Ravi
>
>
> _______________________________________________
> Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
> Post to : openstack at lists.openstack.org
> Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
More information about the Openstack
mailing list