[openstack-dev] [tempest] How to run tempest tests

Sridhar Gaddam sridhar.gaddam at enovance.com
Fri Nov 28 08:32:10 UTC 2014


If the deployment does not support IPv6, we use the following convention 
to skip the tests at class level.
https://github.com/openstack/tempest/blob/master/tempest/api/network/base.py#L65

Regards,
--Sridhar.


On 11/28/2014 01:50 PM, om prakash pandey wrote:
> Hi Folks,
>
> I would like to know about the "best practices" followed for skipping 
> tests not applicable for my environment.
>
> I know one of the ways is to use the below decorator over the test method:
>  @test.skip_because(bug="BUG_ID")
>
> However, what if my deployment doesn't support VPNAAS and I want to 
> skip those tests. Similarly, what if I want to skip the entire suite 
> of sahara(data processing) tests.
>
> Are there any options in testr to customize running of tempest tests 
> as per my environment/requirements?
>
> Regards,
> Om
>
> On Wed, Nov 26, 2014 at 3:13 AM, Vineet Menon <mvineetmenon at gmail.com 
> <mailto:mvineetmenon at gmail.com>> wrote:
>
>     Hi,
>     Thanjs for clearing that up... I had a hard time understanding the
>     screws before I went with testr.
>
>     Regards,
>     Vineet
>
>     On 25 Nov 2014 17:46, "Matthew Treinish" <mtreinish at kortar.org
>     <mailto:mtreinish at kortar.org>> wrote:
>
>         On Mon, Nov 24, 2014 at 10:49:27AM +0100, Angelo Matarazzo wrote:
>         > Sorry for my previous message with wrong subject
>         >
>         > Hi all,
>         > By reading the tempest documentation page [1] a user can run
>         tempest tests
>         > by using whether testr or run_tempest.sh or tox.
>         >
>         > What is the best practice?
>         > run_tempest.sh has several options (e.g. ./run_tempest.sh
>         -h) and it is my
>         > preferred way, currently.
>         > Any thought?
>
>         So the options are there for different reasons and fit
>         different purposes. The
>         run_tempest.sh script exists mostly for legacy reasons as some
>         people prefer to
>         use it, and it predates the usage of tox in tempest. It also
>         has some advantages
>         like that it can run without a venv and provides some other
>         options.
>
>         Tox is what we use for gating, and we keep most of job
>         definitions for gating in
>         the tox.ini file. If you're trying to reproduce a gate run
>         locally using tox is
>         what is recommended to use. Personally I use it to run
>         everything just because
>         I often mix unit tests and tempest runs and I like having
>         separate venvs for
>         both being created on demand.
>
>         Calling testr directly is just what all of these tools are
>         doing under the
>         covers, and it'll always be an option.
>
>         One thing we're looking to do this cycle is to add a single
>         entry point for
>         running tempest which will hopefully clear up this confusion,
>         and make the
>         interface for interacting with tempest a bit nicer. When this
>         work is done, the
>         run_tempest.sh script will most likely disappear and tox will
>         probably just be
>         used for gating job definitions and just call the new
>         entry-point instead of
>         testr directly.
>
>         >
>         > BR,
>         > Angelo
>         >
>         > [1]
>         http://docs.openstack.org/developer/tempest/overview.html#quickstart
>         >
>
>         -Matt Treinish
>
>         _______________________________________________
>         OpenStack-dev mailing list
>         OpenStack-dev at lists.openstack.org
>         <mailto:OpenStack-dev at lists.openstack.org>
>         http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
>
>     _______________________________________________
>     OpenStack-dev mailing list
>     OpenStack-dev at lists.openstack.org
>     <mailto:OpenStack-dev at lists.openstack.org>
>     http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
>
>
>
> _______________________________________________
> OpenStack-dev mailing list
> OpenStack-dev at lists.openstack.org
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-dev/attachments/20141128/a05ee863/attachment.html>


More information about the OpenStack-dev mailing list