[openstack-dev] [neutron] 40% failure on neutron python3.4 tests in the gate

Sean Dague sean at dague.net
Fri Aug 28 13:35:53 UTC 2015


On 08/28/2015 08:50 AM, Kevin Benton wrote:
> Why would that only impact py34 and not py27? Aren't the py27 run with
> testtools?

py34 is only running some subset of tests, so there are a lot of ways
this can go weird.

It may be that the db tests that are failing assume some other tests
which have a db setup thing run before them. In the py27 case there are
enough tests that do that setup that stastically one nearly always runs
before the ones that are problematic.

There are a couple of modes you can run testr in, like --isolated which
will expose tests that are coupled to other tests running before them.
If you generate a local fail you can also --analyze-isolation to figure
out what tests are coupled.

testr also reorders tests to attempt to be faster in aggregate. So run
order is different than it would be in testtools.run case.

In the testtools.run case all the tests are just run in discovery order.

	-Sean

-- 
Sean Dague
http://dague.net



More information about the OpenStack-dev mailing list