Open Stack

tempest defines some sets of tests like "smoke-serial" in tox.ini [1].
We can use "tox -e smoke-serial" or corresponding testr command like

    testr run '(?!.*\[.*\bslow\b.*\])((smoke)|(^tempest\.scenario))'

to run a specific set of tests.
The command runs tests with "smoke" tag and all tests from tempest.scenario
but tests with "slow" tag are not run.

Match pattern like '(?!.*\[.*\bslow\b.*\])((smoke)|(^tempest\.scenario))' at L.91
defines what tests are run. The pattern is a regular expression.
To know what tests to be run, run the following:

     testr list-tests <pattern>

To exclude specific tests, I think the way Sreeram wrote is best (combined with the above).

[1] https://github.com/openstack/tempest/blob/master/tox.ini
[2] https://github.com/openstack/tempest/blob/master/tox.ini#91

Thanks,
Akihiro

(2014/01/22 3:49), Sreeram Yerrapragada wrote:
> For vmware minesweeper ,we filter tests following way:
>
> 1. testr list-tests > alltests
> 2. exclude-tests (file with test names we want to filter)
> 3. alltests - excludetests = tests_to_be_run
> 4. testr run ―load-list=tests_to_be_run
>
> hope that helps
>
>
> On Jan 21, 2014, at 9:56 AM, Lucas Eznarriaga <lucas at midokura.com <mailto:lucas at midokura.com>> wrote:
>
>> Hi,
>>
>>
>>     For step 3/5, is the right procedure. Or is there a way to use a cmd to run all the tests and use a different mechanism to specify a filter for the tests to be run.
>>
>>
>> I don't know if Tempest allows you to filter for the tests to be run.
>> I'm following these steps to configure Jenkins but I still have issues with the Post build actions task to run the commands to scp the test logs in a server to make them available and write its url into the gerrit plugin environment variable to be returned to OS/neutron review.
>> Any hint from someone who has this part already solved?
>>
>> Thanks,
>> Lucas
>>
>> _______________________________________________
>> OpenStack-dev mailing list
>> OpenStack-dev at lists.openstack.org <mailto:OpenStack-dev at lists.openstack.org>
>> https://urldefense.proofpoint.com/v1/url?u=http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev&k=oIvRg1%2BdGAgOoM1BIlLLqw%3D%3D%0A&r=aFCd3VHHntevS%2F4zRg5X3Q67rMfoK4zaQbQ8vktBEac%3D%0A&m=Dd7OAFj8u6FeRIbifSygXPu1BSZlQaiwjO3mnAuaO68%3D%0A&s=ce622e15ad3098f3ba627963122be95f45f269f31550afaf34b176ac35e73870
>