[openstack-dev] [nova] Turbo-hipster

Gary Kotton gkotton at vmware.com
Wed Jan 1 08:40:40 UTC 2014


Thanks for the detailed update. This is very informative and useful.
Thanks

On 12/31/13 11:58 PM, "Michael Still" <mikal at stillhq.com> wrote:

>Hi.
>
>So while turbo hipster is new, I've been reading every failure message
>it produces to make sure its not too badly wrong. There were four
>failures posted last night while I slept:
>
>https://urldefense.proofpoint.com/v1/url?u=https://review.openstack.org/%2
>3/c/64521&k=oIvRg1%2BdGAgOoM1BIlLLqw%3D%3D%0A&r=eH0pxTUZo8NPZyF6hgoMQu%2Bf
>Dtysg45MkPhCZFxPEq8%3D%0A&m=QjlZEwdZOsbG6HW%2FAwjBP1GxhEprFcAcOx%2Btg9BHc4
>Q%3D%0A&s=07845bb3c782af5c62d23c9234df0023cd3d37798ee2ae06d96ac2691419a647
>============================
>
>This one is a TH bug. We shouldn't be testing stable branches.
>bug/1265238 has been filed to track this.
>
>https://urldefense.proofpoint.com/v1/url?u=https://review.openstack.org/%2
>3/c/61753&k=oIvRg1%2BdGAgOoM1BIlLLqw%3D%3D%0A&r=eH0pxTUZo8NPZyF6hgoMQu%2Bf
>Dtysg45MkPhCZFxPEq8%3D%0A&m=QjlZEwdZOsbG6HW%2FAwjBP1GxhEprFcAcOx%2Btg9BHc4
>Q%3D%0A&s=c332d74b6bf0092724c0d10227d71f5ac8df6d0e48ca53d48054503c2e03d031
>============================
>
>This is your review. The failed run's log is
>https://urldefense.proofpoint.com/v1/url?u=https://ssl.rcbops.com/turbo_hi
>pster/logviewer/?q%3D/turbo_hipster/results/61/61753/8/check/gate-real-db-
>upgrade_nova_percona_user_001/1326092/user_001.log&k=oIvRg1%2BdGAgOoM1BIlL
>Lqw%3D%3D%0A&r=eH0pxTUZo8NPZyF6hgoMQu%2BfDtysg45MkPhCZFxPEq8%3D%0A&m=QjlZE
>wdZOsbG6HW%2FAwjBP1GxhEprFcAcOx%2Btg9BHc4Q%3D%0A&s=de964203fc8fb25cd20a54a
>ae34e35a175c3e9bb325e0d442b9a7b7ced78a8ad
>and you can see from the failure message that migrations 152 and 206
>took "too long".
>
>Migration 152 took 326 seconds, where our historical data of 2,846
>test migrations says it should take 222 seconds. Migration 206 took 81
>seconds, where we think it should take 56 seconds based on 2,940 test
>runs.
>
>Whilst I can't explain why those migrations took too long this time
>around, they are certainly exactly the sort of thing TH is meant to
>catch. If you think your patch isn't responsible (perhaps the machine
>is just being slow or something), you can always retest by leaving a
>review comment of "recheck migrations". I have done this for you on
>this patch.
>
>https://urldefense.proofpoint.com/v1/url?u=https://review.openstack.org/%2
>3/c/61717&k=oIvRg1%2BdGAgOoM1BIlLLqw%3D%3D%0A&r=eH0pxTUZo8NPZyF6hgoMQu%2Bf
>Dtysg45MkPhCZFxPEq8%3D%0A&m=QjlZEwdZOsbG6HW%2FAwjBP1GxhEprFcAcOx%2Btg9BHc4
>Q%3D%0A&s=a4bc17a0cfe1ea90890c5468ae2ff8aa1a0a85cb546e641ef8f2588cfad3b9cc
>============================
>
>This review also had similar unexplained slowness, but has already
>been rechecked by someone else and now passes. I note that the
>slowness in both cases was from the same TH worker node, and I will
>keep an eye on that node today.
>
>https://urldefense.proofpoint.com/v1/url?u=https://review.openstack.org/%2
>3/c/56420&k=oIvRg1%2BdGAgOoM1BIlLLqw%3D%3D%0A&r=eH0pxTUZo8NPZyF6hgoMQu%2Bf
>Dtysg45MkPhCZFxPEq8%3D%0A&m=QjlZEwdZOsbG6HW%2FAwjBP1GxhEprFcAcOx%2Btg9BHc4
>Q%3D%0A&s=4a4948f494e74e51749c2d43571071cdeaaef367a00a2f5ceca2ac06d2a0e862
>============================
>
>This review also had slowness in migration 206, but has been rechecked
>by the developer and now passes. It wasn't on the percona-001 worker
>that the other two were on, so perhaps this indicates that we need to
>relax the timing requirements for migration 206.
>
>Hope this helps,
>Michael
>
>On Wed, Jan 1, 2014 at 12:34 AM, Gary Kotton <gkotton at vmware.com> wrote:
>> Hi,
>> It seems that she/he is behaving oddly again. I have posted a patch that
>> does not have any database changes and it has give me a ­1Š.
>> Happy new year
>> Gary
>>
>> _______________________________________________
>> OpenStack-dev mailing list
>> OpenStack-dev at lists.openstack.org
>> 
>>https://urldefense.proofpoint.com/v1/url?u=http://lists.openstack.org/cgi
>>-bin/mailman/listinfo/openstack-dev&k=oIvRg1%2BdGAgOoM1BIlLLqw%3D%3D%0A&r
>>=eH0pxTUZo8NPZyF6hgoMQu%2BfDtysg45MkPhCZFxPEq8%3D%0A&m=QjlZEwdZOsbG6HW%2F
>>AwjBP1GxhEprFcAcOx%2Btg9BHc4Q%3D%0A&s=8ef5e4e15445067795d555001b6b8bdb4de
>>8575c4691f682db06db4f35bce5fe
>>
>
>
>
>-- 
>Rackspace Australia
>
>_______________________________________________
>OpenStack-dev mailing list
>OpenStack-dev at lists.openstack.org
>https://urldefense.proofpoint.com/v1/url?u=http://lists.openstack.org/cgi-
>bin/mailman/listinfo/openstack-dev&k=oIvRg1%2BdGAgOoM1BIlLLqw%3D%3D%0A&r=e
>H0pxTUZo8NPZyF6hgoMQu%2BfDtysg45MkPhCZFxPEq8%3D%0A&m=QjlZEwdZOsbG6HW%2FAwj
>BP1GxhEprFcAcOx%2Btg9BHc4Q%3D%0A&s=8ef5e4e15445067795d555001b6b8bdb4de8575
>c4691f682db06db4f35bce5fe




More information about the OpenStack-dev mailing list