I'm adding jobs [1] to the tempest plugin to run tests against congress stable/queens. The job output seems to show stable/queens getting checked out [2], but I know the test is *not* run against queens because it's using features not available in queens. The expected result is for several tests to fail as seen here [3]. All hints and tips much appreciated! [1] https://review.openstack.org/#/c/591861/1 [2] http://logs.openstack.org/61/591861/1/check/congress-devstack-api-mysql-queens/f7b5752/job-output.txt.gz#_2018-08-14_22_30_36_899501 [3] https://review.openstack.org/#/c/591805/ (the depends-on is irrelevant because that patch has been merged)