[openstack-dev] Migrating to testr parallel in tempest

Thierry Carrez thierry at openstack.org
Wed Aug 14 21:13:18 UTC 2013


Matthew Treinish wrote:
> Also, if anyone has any input on what threshold they feel is good enough
> for this I'd welcome any input on that. For example, do we want to ensure 
> a >= 1:1 match for job success? Or would something like 90% as stable as the
> serial job be good enough considering the speed advantage. (The parallel runs
> take about half as much time as a full serial run, the parallel job normally
> finishes in ~25-30min) Since this affects almost every project I don't want to
> define this threshold without input from everyone.

I guess 90% would be the limit where we'd start questioning it. 95% as
stable then the speed improvement makes it definitely worth it IMHO. At
85% we would introduce way too many new false negatives in the tests,
and those are painful to work around...

-- 
Thierry Carrez (ttx)



More information about the OpenStack-dev mailing list