[openstack-dev] [tempest] list of negative tests that need to be separated from other tests.

Ken'ichi Ohmichi ken1ohmichi at gmail.com
Fri Dec 6 21:06:37 UTC 2013


Hi Adalberto,

2013/12/7 Adalberto Medeiros <adalbas at linux.vnet.ibm.com>:
> Hi!
>
> In the QA meeting yesterday, we decide to create a blueprint specific for
> the negative tests in a separate file:
> https://blueprints.launchpad.net/tempest/+spec/negative-test-files and use
> it to track the patches.

Thank you for pointing this bp out.


> I added the etherpad link Ken'ichi pointed to this bp. Ken'ichi, should you
> be the owner of this bp?

Unfortunately, I could not change the items of this bp from my
launchpad account.
Could you be the owner?

Thanks
Ken'ichi Ohmichi

---
>> On Tue, Dec 3, 2013 at 9:43 AM, Kenichi Oomichi
>> <oomichi at mxs.nes.nec.co.jp <mailto:oomichi at mxs.nes.nec.co.jp>> wrote:
>>
>>
>>     Hi Sean, David, Marc
>>
>>     I have one question about negative tests.
>>     Now we are in moratorium on new negative tests in Tempest:
>>
>> http://lists.openstack.org/pipermail/openstack-dev/2013-November/018748.html
>>
>>     Is it OK to consider this kind of patch(separating negative tests from
>>     positive test file, without any additional negative tests) as an
>>     exception?
>>
>>
>> I don't have a strong opinion on this, but I think it's ok given it
>> will make the eventual removal of
>> hand coded negative tests in the future easier even though it costs us
>> a bit of churn now.
>>
>> Chris
>>
>>
>>     Thanks
>>     Ken'ichi Ohmichi
>>
>>     ---
>>
>>     > -----Original Message-----
>>     > From: Adalberto Medeiros [mailto:adalbas at linux.vnet.ibm.com
>>     <mailto:adalbas at linux.vnet.ibm.com>]
>>     > Sent: Monday, December 02, 2013 8:33 PM
>>     > To: OpenStack Development Mailing List (not for usage questions)
>>     > Subject: Re: [openstack-dev] [tempest] list of negative tests
>>     that need to be separated from other tests.
>>     >
>>     > Thanks Ken'ichi. I added my name to a couple of them in that list.
>>     >
>>     > Adalberto Medeiros
>>     > Linux Technology Center
>>     > Openstack and Cloud Development
>>     > IBM Brazil
>>     > Email: adalbas at linux.vnet.ibm.com
>>     <mailto:adalbas at linux.vnet.ibm.com>
>>
>>     >
>>     > On Mon 02 Dec 2013 07:36:38 AM BRST, Kenichi Oomichi wrote:
>>     > >
>>     > > Hi Adalberto,
>>     > >
>>     > >> -----Original Message-----
>>     > >> From: Adalberto Medeiros [mailto:adalbas at linux.vnet.ibm.com
>>     <mailto:adalbas at linux.vnet.ibm.com>]
>>     > >> Sent: Saturday, November 30, 2013 11:29 PM
>>     > >> To: OpenStack Development Mailing List
>>     > >> Subject: [openstack-dev] [tempest] list of negative tests
>>     that need to be separated from other tests.
>>     > >>
>>     > >> Hi!
>>     > >>
>>     > >> I understand that one action toward negative tests, even before
>>     > >> implementing the automatic schema generation, is to move them
>>     to their
>>     > >> own file (.py), thus separating them from the 'positive'
>>     tests. (See
>>     > >> patch https://review.openstack.org/#/c/56807/ as an example).
>>     > >>
>>     > >> In order to do so, I've got a list of testcases that still
>>     have both
>>     > >> negative and positive tests together, and listed them in the
>>     following
>>     > >> etherpad link:
>>     https://etherpad.openstack.org/p/bp_negative_tests_list
>>     > >>
>>     > >> The idea here is to have patches for each file until we get
>>     all the
>>     > >> negative tests in their own files. I also linked the etherpad
>>     to the
>>     > >> specific blueprint created by Marc for negative tests in icehouse
>>     > >> (https://blueprints.launchpad.net/tempest/+spec/negative-tests ).
>>     > >>
>>     > >> Please, send any comments and whether you think this is the right
>>     > >> approach to keep track on that task.
>>     > >
>>     > > We have already the same etherpad, and we are working on it.
>>     > > Please check the following:
>>     > > https://etherpad.openstack.org/p/TempestTestDevelopment
>>     > >
>>     > >
>>     > > Thanks
>>     > > Ken'ichi Ohmichi
>>     > >
>>     > >
>>     > > _______________________________________________
>>     > > OpenStack-dev mailing list
>>     > > OpenStack-dev at lists.openstack.org
>>     <mailto:OpenStack-dev at lists.openstack.org>
>>
>>     > > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>>     > >
>>     >
>>     >
>>     > _______________________________________________
>>     > OpenStack-dev mailing list
>>     > OpenStack-dev at lists.openstack.org
>>     <mailto:OpenStack-dev at lists.openstack.org>
>>
>>     > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>>
>>     _______________________________________________
>>     OpenStack-dev mailing list
>>     OpenStack-dev at lists.openstack.org
>>     <mailto:OpenStack-dev at lists.openstack.org>
>>
>>     http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>>
>>
>>
>>
>> _______________________________________________
>> OpenStack-dev mailing list
>> OpenStack-dev at lists.openstack.org
>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
>
>
> _______________________________________________
> OpenStack-dev mailing list
> OpenStack-dev at lists.openstack.org
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev



More information about the OpenStack-dev mailing list