[openstack-dev] [Fuel] Test runner for python tests and parallel execution

Chris Dent chdent at redhat.com
Fri Nov 7 16:17:25 UTC 2014

On Fri, 7 Nov 2014, Dmitriy Shulyak wrote:

> As for testrepository - if you have positive experience using this tool,
> share them, from my point of view it has very bad UX.

+1, but with the caveat that testr and its compatriots (e.g.
subunit) appear to have been optimized for automation of huge test
suites and CI contexts. That's a reasonable thing to be but I think
focusing on that side of things has been to detriment of the
human/developer benefits that happen as a result of writing and
running tests.

This is something I'd love for us (people who make OpenStack), as a
shared culture, to address.

> Please consider trying py.test [2], i bet you will notice difference in
> reporting, and maybe will use it yourself for day-to-day test executions.
> Additionally there is very good
> system for parametrizing tests and writing extensions.

I'm with you on this. I love py.test. The user experience for a
human, doing active development, is rather nice indeed.

The difficulty, of course, is that there's been a very large
investment in tools that rely on a particular form of test
discovery that as far as I can tell py.test doesn't want to play
with. If we can overcome that problem...disco.

Chris Dent tw:@anticdent freenode:cdent

More information about the OpenStack-dev mailing list