[Openstack] [Nova] scheduling new instance fail when host aggregates are enabled

sylecn sylecn at gmail.com
Fri Dec 13 04:48:40 UTC 2013


I think I should post the log message here in case someone here knows what
is the problem:

2013-12-13 12:24:15.267 16982 DEBUG
nova.scheduler.filters.compute_capabilities_filter
[req-67cbd36a-f153-4c3e-933d-1e4940315fc9 867dfccf4a14433287d67bf39004336d
860483f3ceeb43aab4d1f0e8f76b4064] (ceph3.geocast.net, ceph3.geocast.net)
ram:1339 disk:273408 io_ops:0 instances:3 fails instance_type extra_specs
requirements host_passes
/usr/lib/python2.7/dist-packages/nova/scheduler/filters/compute_capabilities_filter.py:73

Thanks,
Yuanle


On Fri, Dec 13, 2013 at 12:36 PM, sylecn <sylecn at gmail.com> wrote:

> Thanks Jay.
>
> After enable debug, I found the scheduler fails at
> ComputeCapabilitiesFilter step.
> Recall the filter chain I configured is
>
>
> scheduler_default_filters=RetryFilter,AggregateInstanceExtraSpecsFilter,AvailabilityZoneFilter,RamFilter,ComputeFilter,ComputeCapabilitiesFilter,ImagePropertiesFilter
>
> Now I'm researching why it fails at that filter.
>
> --
> Yuanle
>
>
> On Fri, Dec 13, 2013 at 12:18 PM, Jay Lau <jay.lau.513 at gmail.com> wrote:
>
>> You can enable debug log and check scheduler log to see what's wrong with
>> the filters.
>>
>> Just update /etc/nova/nova.conf, set debug=True and then restart nova
>> scheduler /etc/init.d/openstack-nova-scheduler restart.
>>
>> Thanks,
>>
>> Jay
>>
>>
>> 2013/12/13 sylecn <sylecn at gmail.com>
>>
>>> Hi,
>>>
>>> I have enabled host aggregates to aid scheduling instances on hosts
>>> with cpus of the same type (in order to test live migration). But after
>>> I set it up, scheduling flavor with the extra_specs key-value pair
>>> always fail.
>>>
>>> The logs did not help much. How can I debug this problem?
>>>
>>> I'm running the Havana version in a test environment. Nova controller and
>>> nova-compute are on different nodes.
>>>
>>> Thanks,
>>> Yuanle
>>>
>>> nova-scheduler.log
>>> ====================
>>> 2013-12-13 11:41:11.510 57764 INFO nova.scheduler.filter_scheduler
>>> [req-ad22cb01-07ef-4c79-b42e-49de8ce01473 867dfccf4a14433287d67bf39004336d
>>> 860483f3ceeb43aab4d1f0e8f76b4064] Attempting to build 1 instance(s) uuids:
>>> [u'ab7e8436-f998-4edc-89ee-a9b6bab17fa3']
>>> 2013-12-13 11:41:11.543 57764 WARNING nova.scheduler.driver
>>> [req-ad22cb01-07ef-4c79-b42e-49de8ce01473 867dfccf4a14433287d67bf39004336d
>>> 860483f3ceeb43aab4d1f0e8f76b4064] [instance:
>>> ab7e8436-f998-4edc-89ee-a9b6bab17fa3] Setting instance to ERROR state.
>>>
>>> This is the command use to boot the instance:
>>>
>>> bin/nova boot --flavor lm.c1 --key_name sylecn_at_vboxw1 --image
>>> cirros-0.3.1 --nic net-id=$VM_NET_ID c8
>>>
>>> booting other flavor works fine on the same nova-compute node (
>>> ceph3.geocast.net).
>>>
>>> Here is the host aggregates setup:
>>>
>>> /etc/nova/nova.conf
>>> ===================
>>>
>>> scheduler_default_filters=RetryFilter,AggregateInstanceExtraSpecsFilter,AvailabilityZoneFilter,RamFilter,ComputeFilter,ComputeCapabilitiesFilter,ImagePropertiesFilter
>>>
>>> All nova services are restarted after updating nova.conf.
>>>
>>> sylecn at vboxw1:~/projects/openstack-deploy$ bin/nova flavor-show lm.c1
>>> +----------------------------+--------------------------------------+
>>> | Property                   | Value                                |
>>> +----------------------------+--------------------------------------+
>>> | name                       | lm.c1                                |
>>> | ram                        | 50                                   |
>>> | OS-FLV-DISABLED:disabled   | False                                |
>>> | vcpus                      | 1                                    |
>>> | extra_specs                | {u'cpu_athlon_5k': u'true'}          |
>>> | swap                       |                                      |
>>> | os-flavor-access:is_public | True                                 |
>>> | rxtx_factor                | 1.0                                  |
>>> | OS-FLV-EXT-DATA:ephemeral  | 0                                    |
>>> | disk                       | 1                                    |
>>> | id                         | ab1e6c6e-fbc3-4139-a626-c64aac9b5986 |
>>> +----------------------------+--------------------------------------+
>>> sylecn at vboxw1:~/projects/openstack-deploy$ bin/nova aggregate-details lm
>>>
>>> +----+------+-------------------+------------------------+------------------------------------------------------------+
>>> | Id | Name | Availability Zone | Hosts                  |
>>> Metadata                                                   |
>>>
>>> +----+------+-------------------+------------------------+------------------------------------------------------------+
>>> | 1  | lm   | nova              | [u'ceph3.geocast.net'] |
>>> {u'cpu_athlon_5k': u'true', u'availability_zone': u'nova'} |
>>>
>>> +----+------+-------------------+------------------------+------------------------------------------------------------+
>>> sylecn at vboxw1:~/projects/openstack-deploy$ bin/nova show c8
>>>
>>> +--------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
>>> | Property                             |
>>> Value
>>> |
>>>
>>> +--------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
>>> | status                               |
>>> ERROR
>>> |
>>> | updated                              |
>>> 2013-12-13T03:41:11Z
>>> |
>>> | OS-EXT-STS:task_state                |
>>> None
>>> |
>>> | OS-EXT-SRV-ATTR:host                 |
>>> None
>>> |
>>> | key_name                             |
>>> sylecn_at_vboxw1
>>> |
>>> | image                                | cirros-0.3.1
>>> (42268409-bd69-479b-a423-a6fbe1a51bef)
>>> |
>>> | hostId
>>> |
>>> |
>>> | OS-EXT-STS:vm_state                  |
>>> error
>>> |
>>> | OS-EXT-SRV-ATTR:instance_name        |
>>> instance-0000004c
>>> |
>>> | OS-SRV-USG:launched_at               |
>>> None
>>> |
>>> | OS-EXT-SRV-ATTR:hypervisor_hostname  |
>>> None
>>> |
>>> | flavor                               | lm.c1
>>> (ab1e6c6e-fbc3-4139-a626-c64aac9b5986)
>>> |
>>> | id                                   |
>>> ab7e8436-f998-4edc-89ee-a9b6bab17fa3
>>> |
>>> | OS-SRV-USG:terminated_at             |
>>> None
>>> |
>>> | user_id                              |
>>> 867dfccf4a14433287d67bf39004336d
>>> |
>>> | name                                 |
>>> c8
>>> |
>>> | created                              |
>>> 2013-12-13T03:41:10Z
>>> |
>>> | tenant_id                            |
>>> 860483f3ceeb43aab4d1f0e8f76b4064
>>> |
>>> | OS-DCF:diskConfig                    |
>>> MANUAL
>>> |
>>> | metadata                             |
>>> {}
>>> |
>>> | os-extended-volumes:volumes_attached |
>>> []
>>> |
>>> | accessIPv4
>>> |
>>> |
>>> | accessIPv6
>>> |
>>> |
>>> | fault                                | {u'message': u'No valid host
>>> was found. ', u'code': 500, u'details': u'  File
>>> "/usr/lib/python2.7/dist-packages/nova/scheduler/filter_scheduler.py", line
>>> 107, in schedule_run_instance |
>>> |                                      |     raise
>>> exception.NoValidHost(reason="")
>>> |
>>> |                                      | ', u'created':
>>> u'2013-12-13T03:41:11Z'}
>>> |
>>> | OS-EXT-STS:power_state               |
>>> 0
>>> |
>>> | OS-EXT-AZ:availability_zone          |
>>> nova
>>> |
>>> | config_drive
>>> |
>>> |
>>>
>>> +--------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
>>>
>>>
>>>
>>> _______________________________________________
>>> Mailing list:
>>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
>>> Post to     : openstack at lists.openstack.org
>>> Unsubscribe :
>>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
>>>
>>>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack/attachments/20131213/3e84e093/attachment.html>


More information about the Openstack mailing list