[openstack-dev] [all][tc] Clarifying testing recommendation for interop programs

Matt Riedemann mriedemos at gmail.com
Thu Jan 11 22:52:00 UTC 2018


On 1/11/2018 10:36 AM, Colleen Murphy wrote:
> 1) All trademark-related tests should go in the tempest repo, in accordance
>     with the original resolution. This would mean that even projects that have
>     never had tests in tempest would now have to add at least some of their
>     black-box tests to tempest.
> 
> The value of this option is that centralizes tests used for the Interop program
> in a location where interop-minded folks from the QA team can control them. The
> downside is that projects that so far have avoided having a dependency on
> tempest will now lose some control over the black-box tests that they use for
> functional and integration that would now also be used for trademark
> certification.
> There's also concern for the review bandwidth of the QA team - we can't expect
> the QA team to be continually responsible for an ever-growing list of projects
> and their trademark tests.

How many tests are we talking about for designate and heat? Half a 
dozen? A dozen? More?

If it's just a couple of tests per project it doesn't seem terrible to 
have them live in Tempest so you get the "interop eye" on reviews, as 
noted in your email. If it's a considerable amount, then option 2 seems 
the best for the majority of parties.

-- 

Thanks,

Matt



More information about the OpenStack-dev mailing list