[openstack-dev] [tempest] list of negative tests that need to be separated from other tests.

Christopher Yeoh cbkyeoh at gmail.com
Tue Dec 3 00:23:07 UTC 2013


On Tue, Dec 3, 2013 at 9:43 AM, Kenichi Oomichi
<oomichi at mxs.nes.nec.co.jp>wrote:

>
> Hi Sean, David, Marc
>
> I have one question about negative tests.
> Now we are in moratorium on new negative tests in Tempest:
>
> http://lists.openstack.org/pipermail/openstack-dev/2013-November/018748.html
>
> Is it OK to consider this kind of patch(separating negative tests from
> positive test file, without any additional negative tests) as an exception?
>
>
I don't have a strong opinion on this, but I think it's ok given it will
make the eventual removal of
hand coded negative tests in the future easier even though it costs us a
bit of churn now.

Chris


>
> Thanks
> Ken'ichi Ohmichi
>
> ---
>
> > -----Original Message-----
> > From: Adalberto Medeiros [mailto:adalbas at linux.vnet.ibm.com]
> > Sent: Monday, December 02, 2013 8:33 PM
> > To: OpenStack Development Mailing List (not for usage questions)
> > Subject: Re: [openstack-dev] [tempest] list of negative tests that need
> to be separated from other tests.
> >
> > Thanks Ken'ichi. I added my name to a couple of them in that list.
> >
> > Adalberto Medeiros
> > Linux Technology Center
> > Openstack and Cloud Development
> > IBM Brazil
> > Email: adalbas at linux.vnet.ibm.com
> >
> > On Mon 02 Dec 2013 07:36:38 AM BRST, Kenichi Oomichi wrote:
> > >
> > > Hi Adalberto,
> > >
> > >> -----Original Message-----
> > >> From: Adalberto Medeiros [mailto:adalbas at linux.vnet.ibm.com]
> > >> Sent: Saturday, November 30, 2013 11:29 PM
> > >> To: OpenStack Development Mailing List
> > >> Subject: [openstack-dev] [tempest] list of negative tests that need
> to be separated from other tests.
> > >>
> > >> Hi!
> > >>
> > >> I understand that one action toward negative tests, even before
> > >> implementing the automatic schema generation, is to move them to their
> > >> own file (.py), thus separating them from the 'positive' tests. (See
> > >> patch https://review.openstack.org/#/c/56807/ as an example).
> > >>
> > >> In order to do so, I've got a list of testcases that still have both
> > >> negative and positive tests together, and listed them in the following
> > >> etherpad link:
> https://etherpad.openstack.org/p/bp_negative_tests_list
> > >>
> > >> The idea here is to have patches for each file until we get all the
> > >> negative tests in their own files. I also linked the etherpad to the
> > >> specific blueprint created by Marc for negative tests in icehouse
> > >> (https://blueprints.launchpad.net/tempest/+spec/negative-tests ).
> > >>
> > >> Please, send any comments and whether you think this is the right
> > >> approach to keep track on that task.
> > >
> > > We have already the same etherpad, and we are working on it.
> > > Please check the following:
> > > https://etherpad.openstack.org/p/TempestTestDevelopment
> > >
> > >
> > > Thanks
> > > Ken'ichi Ohmichi
> > >
> > >
> > > _______________________________________________
> > > OpenStack-dev mailing list
> > > OpenStack-dev at lists.openstack.org
> > > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
> > >
> >
> >
> > _______________________________________________
> > OpenStack-dev mailing list
> > OpenStack-dev at lists.openstack.org
> > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
> _______________________________________________
> OpenStack-dev mailing list
> OpenStack-dev at lists.openstack.org
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-dev/attachments/20131203/ccf4ecba/attachment.html>


More information about the OpenStack-dev mailing list