[openstack-dev] Nova + testr?
Joshua Harlow
harlowja at yahoo-inc.com
Sat Feb 2 17:36:08 UTC 2013
Haha, even in parallel u could just have X progress bars ya?
Thanks for the babble, I was looking through testr docs/code and wasn't able to figure out to much. Your 'dump' helps.
Sent from my really tiny device...
On Feb 1, 2013, at 11:20 PM, "Monty Taylor" <mordred at inaugust.com> wrote:
>
>
> On 02/02/2013 04:10 PM, Joshua Harlow wrote:
>> Howdy all,
>>
>> Just was running the nova unit tests and getting used to the testr
>> running and was wondering if there is anyway to see exactly what tests
>> its running (since the nova tests take a long long time to complete).
>>
>> Is this a feature that is hidden, or something that others have been
>> using to do this.
>>
>> Even having a simple progress bar would be nice, just to show that
>> something is happening…
>>
>> Right now it just goes into:
>>
>> Running ` python setup.py testr --slowest --testr-args=' '`
>> running testr
>> running=OS_STDOUT_CAPTURE=1 OS_STDERR_CAPTURE=1 OS_TEST_TIMEOUT=60
>> ${PYTHON:-python} -m subunit.run discover -t ./ ./nova/tests
>>
>> And stays like that for a long while, not the best CLI ui :-/
>>
>> Anyone doing something that might improve that?
>
> Yeah - there is a todo list item to support incremental output printing.
> The main reason it's a todo item and not done already is that it gets
> trickier to get it to be fully useful when we're running in parallel
> mode (there's a plan, we've just been busy)
>
> HOWEVER - this is a smart crowd, so I'm going to babble for a second.
>
> When testr runs things, it's actually running them via the subunit test
> runner, which runs python unittests and outputs their results in subunit
> format. subunit is a language independent streaming test result
> protocol, and testr is a test runner runner that handles things that
> know how to deal with subunit.
>
> If you'd like to see a VERY VERBOSE dump of everything that is
> happening, do this:
>
> testr run --subunit --full-results
>
> You'll see the subunit stream that testr is consuming stream by. If you
> want to track what's running (not success or failure) do this:
>
> testr run --subunit --full-results | grep '^test:'
>
> And you'll see a sequence of lines like this:
>
> test:
> nova.tests.api.ec2.test_cinder_cloud.CinderCloudTestCase.test_create_snapshot
>
> If you want to see results:
>
> testr run --subunit --full-results | grep -E
> '^(successful|failure|error|skip|notsupported):'
>
> Will get you test results.
>
> NOW - that's great for a temp fix, and honestly, I could probably clean
> that up just a smidge and put it into run_tests.sh ... but what we want
> is something that sits between testr and subunit - because testr run
> --parallel runs things in multiple processes and we want to make that
> work right.
>
> However, having just brain-vomited all of that, I've got an idea...
> lemme write a quick patch...
>
> Monty
>
> _______________________________________________
> OpenStack-dev mailing list
> OpenStack-dev at lists.openstack.org
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
More information about the OpenStack-dev
mailing list