[openstack-dev] [QA][Tempest]Run only multinode tests in multinode jobs
ihrachys at redhat.com
Mon Feb 22 10:42:36 UTC 2016
Assaf Muller <amuller at redhat.com> wrote:
> On Tue, Feb 16, 2016 at 2:52 PM, Matthew Treinish <mtreinish at kortar.org>
>> On Tue, Feb 16, 2016 at 10:07:19AM +0100, Jordan Pittier wrote:
>>> Hi list,
>>> I understood we need to limit the number of tests and jobs that are run
>>> each Tempest patch because our resources are not unlimited.
>>> In Tempest, we have 5 multinode experimental jobs:
>>> These jobs largely overlap with the non-multinode jobs. What about
>>> (with a python decorator) each test that really requires multiple nodes
>>> only run those tests as part of the multinode jobs ?
>> So I don't think this is wise. I'm fine with adding a tag (or more
>> realistically a new decorator that sets the attr and bakes in the skip
>> to mark tests that require more than 1 node to work. But, limiting all the
>> multinode jobs to just that set doesn't make too much sense to me. For
>> most of
>> those jobs you listed the point is to verify that everything things work
>> same at >1 node, not just features that require more than 1 node. (with
>> the exception of the live-migration job which I assume just runs live
>> What is probably a better question to ask is why we need 5 different
>> jobs in the tempest experimental queue? Tempest will always have a
>> higher than
>> average number of tempest-dsvm jobs running because so much of the code
>> is self
>> verifying. But, do all of those jobs really improve our coverage of
>> code? Like what does the dibtest job buy us? Or why do we need 2 different
>> types of neutron deployments running?
> I can't speak for the other three jobs, but these two:
> Are both in the check queue and are non-voting. Both are hovering
> around 50% failure rate for a while now. Ihar and Sean (CC'd) are
> working on the non-DVR job, solving issues around MTU.
Not really, we were looking at *grenade* multinode neutron jobs only. And I
think with recent fixes in nova, non-dvr grenade job is fixed, and we
tackled all *gate blocking* MTU issues.
Next step for us is DVR job for grenade. But again, it has nothing to do
with tempest flavours of it.
More information about the OpenStack-dev