<font size=2 face="sans-serif">I put a nose.cfg with my excludes in the
user's root and it works to run nosetests via the virtual environment like
this:</font>
<br>
<br><font size=2 face="sans-serif">tempest/tools/./with_venv.sh nosetests</font>
<br>
<br><font size=2 face="sans-serif">I had to use the run_tests.sh script
in tempest to create the virtual environment, but after that running tempest
via nose within the venv wasn't a problem. Of course, I didn't want
to duplicate the test runs when setting up the venv via run_tests.sh, so
I created it with the -p option to only run pep8 after it was setup (I'm
not aware of a way to tell it to not run any tests and simply setup the
environment).</font>
<br>
<br><font size=2 face="sans-serif">Going back to the bug I opened last
night for failures on py26, it's fixed with this patch: </font><a href=https://review.openstack.org/#/c/39346/><font size=3 color=blue><u>https://review.openstack.org/#/c/39346/</u></font></a><font size=3>
</font><font size=2 face="sans-serif"><br>
</font>
<br><font size=2 face="sans-serif"><br>
</font>
<br><font size=1 face="Arial">Thanks,</font>
<br>
<br><font size=3 color=#8f8f8f face="Arial"><b>MATT RIEDEMANN</b></font><font size=1 face="Arial"><br>
Advisory Software Engineer<br>
Cloud Solutions and OpenStack Development</font>
<table width=680 style="border-collapse:collapse;">
<tr height=8>
<td width=680 colspan=2 style="border-style:solid;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;">
<hr>
<tr valign=top height=8>
<td width=418 style="border-style:solid;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=1 color=#4181c0 face="Arial"><b>Phone:</b></font><font size=1 color=#5f5f5f face="Arial">
1-507-253-7622</font><font size=1 color=#4181c0 face="Arial"> | <b>Mobile:</b></font><font size=1 color=#5f5f5f face="Arial">
1-507-990-1889</font><font size=1 color=#4181c0 face="Arial"><b><br>
E-mail:</b></font><font size=1 color=#5f5f5f face="Arial"> </font><a href=mailto:mriedem@us.ibm.com target=_blank><font size=1 color=#5f5f5f face="Arial"><u>mriedem@us.ibm.com</u></font></a>
<td width=261 style="border-style:solid;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;">
<div align=right><img src=cid:_1_0C8573B00C856E1C005F5FDD86257BC7 width=83 height=30 alt=IBM><font size=1 color=#5f5f5f face="Arial"><br>
<br>
3605 Hwy 52 N<br>
Rochester, MN 55901-1407<br>
United States</font></div></table>
<br>
<br>
<br>
<br>
<br><font size=1 color=#5f5f5f face="sans-serif">From:
</font><font size=1 face="sans-serif">Alexius Ludeman <lex@lexinator.com></font>
<br><font size=1 color=#5f5f5f face="sans-serif">To:
</font><font size=1 face="sans-serif">OpenStack Development
Mailing List <openstack-dev@lists.openstack.org>, </font>
<br><font size=1 color=#5f5f5f face="sans-serif">Date:
</font><font size=1 face="sans-serif">08/14/2013 11:39 AM</font>
<br><font size=1 color=#5f5f5f face="sans-serif">Subject:
</font><font size=1 face="sans-serif">Re: [openstack-dev]
Skipping tests in tempest via config file</font>
<br>
<hr noshade>
<br>
<br>
<br><font size=3>I am running tempest on OEL 6.3 (aka RHEL 6.3) and I had
issues with python 2.6 and skipException[3], so now I'm using python 2.7
just for tempest. I also had difficulty with yum and python module
dependency and made the transition to venv. This has reduced the
yum dependency nightmare greatly.</font>
<br>
<br><font size=3>now that testr is default for tempest. testr does
not appear to support --exclusion[1] or --stop[2].</font>
<br>
<br><font size=3>I have a work around for --exclusion, by:</font>
<br><font size=3>testr list-tests | egrep -v regex-exclude-list >
unit-tests.txt</font>
<br><font size=3>testr --load-list unit-tests.txt</font>
<br>
<br><font size=3>I do not have a work around for --stop.</font>
<br>
<br><font size=3>[1]</font><a href="https://bugs.launchpad.net/testrepository/+bug/1208610"><font size=3 color=blue><u>https://bugs.launchpad.net/testrepository/+bug/1208610</u></font></a>
<br><font size=3>[2]</font><a href="https://bugs.launchpad.net/testrepository/+bug/1211926"><font size=3 color=blue><u>https://bugs.launchpad.net/testrepository/+bug/1211926</u></font></a>
<br><font size=3>[3]</font><a href="https://bugs.launchpad.net/tempest/+bug/1202815"><font size=3 color=blue><u>https://bugs.launchpad.net/tempest/+bug/1202815</u></font></a>
<br>
<br><font size=3><br>
</font>
<br><font size=3>On Tue, Aug 13, 2013 at 7:25 PM, Matt Riedemann <</font><a href=mailto:mriedem@us.ibm.com target=_blank><font size=3 color=blue><u>mriedem@us.ibm.com</u></font></a><font size=3>>
wrote:</font>
<br><font size=3 face="sans-serif">I have the same issue. I run a
subset of the tempest tests via nose on a RHEL 6.4 VM directly against
the site-packages (not using virtualenv). I'm running on x86_64,
ppc64 and s390x and have different issues on all of them (a mix of DB2
on x86_64 and MySQL on the others, and different nova/cinder drivers on
each). What I had to do was just make a nose.cfg for each of them
and throw that into ~/ for each run of the suite.</font><font size=3> <br>
</font><font size=3 face="sans-serif"><br>
The switch from nose to testr hasn't impacted me because I'm not using
a venv. However, there was a change this week that broke me on python
2.6 and I opened this bug:</font><font size=3> <br>
</font><font size=3 color=blue><u><br>
</u></font><a href="https://bugs.launchpad.net/tempest/+bug/1212071" target=_blank><font size=3 color=blue><u>https://bugs.launchpad.net/tempest/+bug/1212071</u></font></a><font size=3>
<br>
</font><font size=3 face="sans-serif"><br>
</font><font size=3><br>
</font><font size=1 face="Arial"><br>
Thanks,</font><font size=3> <br>
</font><font size=3 color=#8f8f8f face="Arial"><b><br>
MATT RIEDEMANN</b></font><font size=1 face="Arial"><br>
Advisory Software Engineer<br>
Cloud Solutions and OpenStack Development</font><font size=3> </font>
<table width=680 style="border-collapse:collapse;">
<tr height=8>
<td width=678 colspan=2 style="border-style:solid;border-color:#000000;border-width:0px 0px 0px 0px;padding:1px 1px;">
<hr>
<tr valign=top height=8>
<td width=416 style="border-style:solid;border-color:#000000;border-width:0px 0px 0px 0px;padding:1px 1px;"><font size=1 color=#4181c0 face="Arial"><b>Phone:</b></font><font size=1 color=#5f5f5f face="Arial">
</font><a href="tel:1-507-253-7622" target=_blank><font size=1 color=blue face="Arial"><u>1-507-253-7622</u></font></a><font size=1 color=#4181c0 face="Arial">
| <b>Mobile:</b></font><font size=1 color=#5f5f5f face="Arial"> </font><a href="tel:1-507-990-1889" target=_blank><font size=1 color=blue face="Arial"><u>1-507-990-1889</u></font></a><font size=1 color=#4181c0 face="Arial"><b><br>
E-mail:</b></font><font size=1 color=#5f5f5f face="Arial"> </font><a href=mailto:mriedem@us.ibm.com target=_blank><font size=1 color=#5f5f5f face="Arial"><u>mriedem@us.ibm.com</u></font></a><font size=3>
</font>
<td width=259 style="border-style:solid;border-color:#000000;border-width:0px 0px 0px 0px;padding:1px 1px;">
<div align=right><img src=cid:_1_0C7517B40C7513B4005F5FDD86257BC7 width=83 height=30 alt=IBM><font size=1 color=#5f5f5f face="Arial"><br>
<br>
3605 Hwy 52 N<br>
Rochester, MN 55901-1407<br>
United States</font></div></table>
<br><font size=3><br>
<br>
<br>
<br>
</font><font size=1 color=#5f5f5f face="sans-serif"><br>
From: </font><font size=1 face="sans-serif">Ian
Wienand <</font><a href=mailto:iwienand@redhat.com target=_blank><font size=1 color=blue face="sans-serif"><u>iwienand@redhat.com</u></font></a><font size=1 face="sans-serif">></font><font size=3>
</font><font size=1 color=#5f5f5f face="sans-serif"><br>
To: </font><a href="mailto:openstack-dev@lists.openstack.org" target=_blank><font size=1 color=blue face="sans-serif"><u>openstack-dev@lists.openstack.org</u></font></a><font size=1 face="sans-serif">,
</font><font size=1 color=#5f5f5f face="sans-serif"><br>
Date: </font><font size=1 face="sans-serif">08/13/2013
09:13 PM</font><font size=3> </font><font size=1 color=#5f5f5f face="sans-serif"><br>
Subject: </font><font size=1 face="sans-serif">[openstack-dev]
Skipping tests in tempest via config file</font><font size=3> <br>
</font>
<hr noshade>
<br><font size=3><br>
<br>
</font><tt><font size=3><br>
Hi,<br>
<br>
I proposed a change to tempest that skips tests based on a config file<br>
directive [1]. Reviews were inconclusive and it was requested the<br>
idea be discussed more widely.<br>
<br>
Of course issues should go upstream first. However, sometimes test<br>
failures are triaged to a local/platform problem and it is preferable<br>
to keep everything else running by skipping the problematic tests<br>
while its being worked on.<br>
<br>
My perspective is one of running tempest in a mixed CI environment<br>
with RHEL, Fedora, etc. Python 2.6 on RHEL doesn't support testr
(it<br>
doesn't do the setUpClass calls required by temptest) and nose<br>
upstream has some quirks that make it hard to work with the tempest<br>
test layout [2].<br>
<br>
Having a common place in the temptest config to set these skips is<br>
more convienent than having to deal with the multiple testing<br>
environments.<br>
<br>
Another proposal is to have a separate JSON file of skipped tests. I<br>
don't feel strongly but it does seem like another config file.<br>
<br>
-i<br>
<br>
[1] </font></tt><a href=https://review.openstack.org/#/c/39417/ target=_blank><tt><font size=3 color=blue><u>https://review.openstack.org/#/c/39417/</u></font></tt></a><tt><font size=3><br>
[2] </font></tt><a href="https://github.com/nose-devs/nose/pull/717" target=_blank><tt><font size=3 color=blue><u>https://github.com/nose-devs/nose/pull/717</u></font></tt></a><tt><font size=3><br>
<br>
_______________________________________________<br>
OpenStack-dev mailing list</font></tt><tt><font size=3 color=blue><u><br>
</u></font></tt><a href="mailto:OpenStack-dev@lists.openstack.org" target=_blank><tt><font size=3 color=blue><u>OpenStack-dev@lists.openstack.org</u></font></tt></a><font size=3 color=blue><u><br>
</u></font><a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" target=_blank><tt><font size=3 color=blue><u>http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev</u></font></tt></a><tt><font size=3><br>
</font></tt><font size=3><br>
</font>
<br><font size=3><br>
_______________________________________________<br>
OpenStack-dev mailing list</font><font size=3 color=blue><u><br>
</u></font><a href="mailto:OpenStack-dev@lists.openstack.org"><font size=3 color=blue><u>OpenStack-dev@lists.openstack.org</u></font></a><font size=3 color=blue><u><br>
</u></font><a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" target=_blank><font size=3 color=blue><u>http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev</u></font></a><font size=3><br>
</font>
<br><tt><font size=2>_______________________________________________<br>
OpenStack-dev mailing list<br>
OpenStack-dev@lists.openstack.org<br>
</font></tt><a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev"><tt><font size=2>http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev</font></tt></a><tt><font size=2><br>
</font></tt>
<br>