[openstack-dev] [all][tc] Clarifying testing recommendation for interop programs
mriedemos at gmail.com
Thu Jan 11 22:52:00 UTC 2018
On 1/11/2018 10:36 AM, Colleen Murphy wrote:
> 1) All trademark-related tests should go in the tempest repo, in accordance
> with the original resolution. This would mean that even projects that have
> never had tests in tempest would now have to add at least some of their
> black-box tests to tempest.
> The value of this option is that centralizes tests used for the Interop program
> in a location where interop-minded folks from the QA team can control them. The
> downside is that projects that so far have avoided having a dependency on
> tempest will now lose some control over the black-box tests that they use for
> functional and integration that would now also be used for trademark
> There's also concern for the review bandwidth of the QA team - we can't expect
> the QA team to be continually responsible for an ever-growing list of projects
> and their trademark tests.
How many tests are we talking about for designate and heat? Half a
dozen? A dozen? More?
If it's just a couple of tests per project it doesn't seem terrible to
have them live in Tempest so you get the "interop eye" on reviews, as
noted in your email. If it's a considerable amount, then option 2 seems
the best for the majority of parties.
More information about the OpenStack-dev