[openstack-qa] tempest gate timeouts

Sean Dague sean at dague.net
Mon May 20 18:48:58 UTC 2013


On 05/20/2013 12:37 PM, Martina Kollarova wrote:
> I don't know, but I'm having the same problem.
>
> http://logs.openstack.org/29640/1/gate/gate-tempest-devstack-vm-quantum/23307/

So the crux of this one is triggering a race in nova compute where it 
tries to call a libvirt domain during a critical moment when it's coming 
up and creating the following (in logs/n-cpu.txt.gz



2013-05-20 15:47:13.460 DEBUG nova.openstack.common.rpc.amqp 
[req-ddd6a6f2-7a52-49d3-8545-9e035aeb0134 demo demo] Making synchronous 
call on conductor ... multicall 
/opt/stack/new/nova/nova/openstack/common/rpc/amqp.py:586
2013-05-20 15:47:13.460 DEBUG nova.openstack.common.rpc.amqp 
[req-ddd6a6f2-7a52-49d3-8545-9e035aeb0134 demo demo] MSG_ID is 
5e5496e2328b45dd8f04b031346ec79a multicall 
/opt/stack/new/nova/nova/openstack/common/rpc/amqp.py:589
2013-05-20 15:47:13.461 DEBUG nova.openstack.common.rpc.amqp 
[req-ddd6a6f2-7a52-49d3-8545-9e035aeb0134 demo demo] UNIQUE_ID is 
3e22c5ab4a264091b3a53572a4e5c518. _add_unique_id 
/opt/stack/new/nova/nova/openstack/common/rpc/amqp.py:337
2013-05-20 15:47:13.480 DEBUG nova.openstack.common.lockutils 
[req-ddd6a6f2-7a52-49d3-8545-9e035aeb0134 demo demo] Got semaphore 
"3e9b1297-caf1-4daf-8127-919b8ba68fc4" for method "do_run_instance"... 
inner /opt/stack/new/nova/nova/openstack/common/lockutils.py:190

libvir: QEMU error : Domain not found: no domain with matching name 
'instance-0000000b'

2013-05-20 15:47:13.485 AUDIT nova.compute.manager 
[req-ddd6a6f2-7a52-49d3-8545-9e035aeb0134 demo demo] [instance: 
3e9b1297-caf1-4daf-8127-919b8ba68fc4] Starting instance...
2013-05-20 15:47:13.485 DEBUG nova.openstack.common.rpc.amqp 
[req-ddd6a6f2-7a52-49d3-8545-9e035aeb0134 demo demo] Making synchronous 
call on conductor ... multicall 
/opt/stack/new/nova/nova/openstack/common/rpc/amqp.py:586
2013-05-20 15:47:13.486 DEBUG nova.openstack.common.rpc.amqp 
[req-ddd6a6f2-7a52-49d3-8545-9e035aeb0134 demo demo] MSG_ID is 
9575e0717bd04198ad7eba9d3f93bebf multicall 
/opt/stack/new/nova/nova/openstack/common/rpc/amqp.py:589
2013-05-20 15:47:13.486 DEBUG nova.openstack.common.rpc.amqp 
[req-ddd6a6f2-7a52-49d3-8545-9e035aeb0134 demo demo] UNIQUE_ID is 
b3065b52c8724a90915e9d9ac7419d25. _add_unique_id 
/opt/stack/new/nova/nova/openstack/common/rpc/amqp.py:337


The libvirt fail is a real fail, a real race in OpenStack, but as with 
all races it comes up only so often.

	-Sean

>
>
> On Sun 19 May 2013 02:07:32 AM CEST, Henry Gessau wrote:
>> Examples:
>> http://logs.openstack.org/29184/8/check/gate-tempest-devstack-vm-quantum/23288/
>>
>> http://logs.openstack.org/29640/1/gate/gate-tempest-devstack-vm-quantum/23307/
>>
>>
>> Maintenance going on? Or something kaput?
>>
>>
>> _______________________________________________
>> openstack-qa mailing list
>> openstack-qa at lists.openstack.org
>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-qa
>
> --
> Martina Kollarova
> RedHat OpenStack Storage QE, Brno
>
> _______________________________________________
> openstack-qa mailing list
> openstack-qa at lists.openstack.org
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-qa


-- 
Sean Dague
http://dague.net



More information about the openstack-qa mailing list