[openstack-dev] Thoughts on the patch test failure rate and moving forward

Russell Bryant rbryant at redhat.com
Thu Jul 24 16:22:05 UTC 2014


On 07/23/2014 05:39 PM, James E. Blair wrote:
> ==Final thoughts==
> 
> The current rate of test failures and subsequent rechecks is not
> sustainable in the long term.  It's not good for contributors,
> reveiewers, or the overall project quality.  While these bugs do need to
> be addressed, it's unlikely that the current process will cause that to
> happen.  Instead, we want to push more substantial testing into the
> projects themselves with functional and interface testing, and depend
> less on devstack-gate integration tests to catch all bugs.  This should
> help us catch bugs closer to the source and in an environment where
> debugging is easier.  We also want to reduce the scope of devstack gate
> tests to a gold standard while running tests of other configurations in
> a traditional CI process so that people interested in those
> configurations can focus on ensuring they work.

Very nice writeup.  I think these steps sound like a positive way forward.

Thanks!

-- 
Russell Bryant



More information about the OpenStack-dev mailing list