[openstack-dev] [qa] moratorium on new negative tests in Tempest

Sean Dague sean at dague.net
Wed Nov 13 12:33:37 UTC 2013


On 11/12/2013 01:36 PM, Clint Byrum wrote:
> Excerpts from Sean Dague's message of 2013-11-12 10:01:06 -0800:
>> During the freeze phase of Havana we got a ton of new contributors
>> coming on board to Tempest, which was super cool. However it meant we
>> had this new influx of negative tests (i.e. tests which push invalid
>> parameters looking for error codes) which made us realize that human
>> creation and review of negative tests really doesn't scale. David Kranz
>> is working on a generative model for this now.
>>
> 
> Are there some notes or other source material we can follow to understand
> this line of thinking? I don't agree or disagree with it, as I don't
> really understand, so it would be helpful to have the problems enumerated
> and the solution hypothesis stated. Thanks!

Here is our etherpad from the session -
https://etherpad.openstack.org/p/icehouse-summit-qa-negative-tests -
it's actually probably a little sparser than it should be.

	-Sean

-- 
Sean Dague
http://dague.net

-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 482 bytes
Desc: OpenPGP digital signature
URL: <http://lists.openstack.org/pipermail/openstack-dev/attachments/20131113/5ae5289c/attachment.pgp>


More information about the OpenStack-dev mailing list