[openstack-dev] [all] Branchless Tempest QA Spec - final draft

Sean Dague sean at dague.net
Wed Apr 16 18:52:12 UTC 2014


On 04/16/2014 11:48 AM, Jaume Devesa wrote:
> Hi Sean,
> 
> for what I understood, we will need a new feature flag for each new
> feature, and a feature flag (default to false) for each deprecated one.
> My concern is: since the goal is make tempest a confident tool to test
> any installation and not and 'tempest.conf' will not be auto-generated
> from any tool as devstack does, wouldn't be too hard to prepare a
> tempest.conf file with so many feature flags to enable and disable?
> 
> Maybe I am simplifying too much, but wouldn't be enough with a pair of
> functions decorators like
> 
> @new
> @deprecated
> 
> Then, in tempest.conf it could be a flag to say which OpenStack
> installation are you testing:
> 
> installation = [icehouse|juno]
> 
> if you choose Juno, tests with @new decorator will be executed and tests
> with @deprecated will be skipped.
> If you choose Icehouse, tests with @new decorator will be skipped, and
> tests with @deprecated will be executed

And when it's icehouse, juno, and K at the same time (there will be 5
months where all 3 will be supported)?

> I am missing some obvious case that make this approach a nonsense?

What version would you provide for rackspace, hp public cloud, dream
cloud, cloud watt, or any other public cloud out there? Releases mean
something to us, but they mean very little to many folks that are
continuously deploying OpenStack.

The feature flags will be for features that are explicitly optional,
such as compute API extensions and swift middleware. As long as these
APIs have optional content, we have to support people testing with and
without the optional content enabled.

	-Sean

-- 
Sean Dague
Samsung Research America
sean at dague.net / sean.dague at samsung.com
http://dague.net

-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 547 bytes
Desc: OpenPGP digital signature
URL: <http://lists.openstack.org/pipermail/openstack-dev/attachments/20140416/d28bbea6/attachment.pgp>


More information about the OpenStack-dev mailing list