Open Stack

Matthew Treinish <mtreinish at kortar.org> writes:

> This should improve the run times for tempest jobs to between 20-30min
> on average which will definitely help with the upcoming milestone
> rush.

This is great!  Thanks to you and the Tempest team for getting this
_huge_ effort done!  I'm really excited that we're able to run existing
tests more realistically and faster, as well as opening the door to
running even more tests in the future!

> So I'm asking everyone to be diligent with watching (and using) the recheck list
> and that all the devs just don't recheck and forget. We need a combined effort from
> everyone to make things stable and debug seemingly random failures when they
> come up. If we can iron out most of the flakiness by the milestone rush having
> the faster runtime will definitely help make the surge easier for everyone.

It's not that much fun, but when we've had flakey tests in the past,
diligent use of the recheck system has _really_ helped the people
working on tracking those problems down.  For reference, here's the
procedure to use:

  https://wiki.openstack.org/wiki/GerritJenkinsGithub#Test_Failures

-Jim