[openstack-dev] [gate] RFC dropping largeops tests
flavio at redhat.com
Wed Feb 10 13:23:35 UTC 2016
On 10/02/16 07:33 -0500, Sean Dague wrote:
>The largeops tests at this point are mostly finding out that some of our
>new cloud providers are slow - http://tinyurl.com/j5u4nf5
>This is fundamentally a performance test, with timings having been tuned
>to pass 98% of the time on two clouds that were very predictable in
>performance. We're now running on 4 clouds, and the variance between
>them all, and between every run on each can be as much as a factor of 2.
>We could just bump all the timeouts again, but that's basically the same
>thing as dropping them.
>These tests are not instrumented in a way that any real solution can be
>addressed in most cases. Tests without a path forward, that are failing
>good patches a lot, are very much the kind of thing we should remove
>from the system.
no objections here!
-------------- next part --------------
A non-text attachment was scrubbed...
Size: 819 bytes
Desc: not available
More information about the OpenStack-dev