[openstack-dev] [qa][tempest][rally] Seems like Tempest breaks Rally gates

Matthew Treinish mtreinish at kortar.org
Tue Nov 18 14:46:19 UTC 2014

On Tue, Nov 18, 2014 at 06:29:55PM +0400, Boris Pavlovic wrote:
> Hi stackers,
> As far as you maybe know Rally has "rally verify" command that simplifies
> usage of tempest.
> We are testing this functionality in our gates on every patch (for about
> month).
> Everything was fine until today when it started failing.
> We are running 2 different tempest sets (image and smoke). And smoke one
> started failing.
> I thought that something is wrong with Rally & Tempst integration, and
> tried to run on fresh DevStack node just smoke tests from tempest via next
> command:  "./run_tempest.sh -s"
> I got next result:
> Ran 0 tests in 4.499s
> > OK
> > stack at akurilin-virt-0:~/tempest$ git log -1
> > commit 9556987fbfc906f386939b3903253aa8ff17d91d
> > Merge: aee83e2 cd4a51e
> > Author: Jenkins <jenkins at review.openstack.org>
> > Date:   Tue Nov 18 12:42:41 2014 +0000
> >     Merge "Add internal methods for setting compute clients"
> >
> Any thoughts?

This is actually an issue that the entire gate was hitting yesterday, not just
Rally. With the release of testtools 1.4.0, attrs in tempest broke, (which is
probably a unittest2 bug being exposed) this caused the regex filters on
attributes to stop working which broke a bunch of jobs. In the short term we've
landed global requirements changes to exclude that testtools version, you
probably just need to do the same on Rally to avoid the version which doesn't

There is also tempest-side fix in progress here:


But, that will take a bit longer to land.

-Matt Treinish
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 819 bytes
Desc: not available
URL: <http://lists.openstack.org/pipermail/openstack-dev/attachments/20141118/93e16499/attachment.pgp>

More information about the OpenStack-dev mailing list