[openstack-dev] [Fuel] Test runner for python tests and parallel execution

Evgeniy L eli at mirantis.com
Fri Nov 7 15:17:36 UTC 2014


Hi Dmitry,

Thank you for bringing it up, it's not only about CI, it really takes
a lot of developers time to run Nailgun unit/integration tests on local
machine, and it's must have priority task in technical debt scope.

Personally I'm ok with py.test, but we should improve db creation mechanism
in your patch to use psycopg2 instead of running psql in subprocess.

Thanks,

On Fri, Nov 7, 2014 at 5:35 PM, Dmitriy Shulyak <dshulyak at mirantis.com>
wrote:

> Hi guys,
> Long time ago i've made patch [1] which added tests distribution between
> processes and databases.  It was simple py.test configuration which allows
> us to reduce time of test execution almost linearly, on my local machine
> one test run (distributed over 4 cores) takes 250 seconds.
>
> At that time idea of using py.test was discarded, because:
> 1. it is neither nosetests
> 2. nor openstack community way (testrepository)
>
> There is plugin for nosetests which adds multiprocessing support (maybe it
> is even included in default distribution) but i wasnt able to find a normal
> way of distribution over databases, just because runner doesnot include
> necessery config options like RUNNER_ID. I cant stop you
> from trying - so please share your results, if you will find a nice and
> easy way to make it work.
>
> As for testrepository - if you have positive experience using this tool,
> share them, from my point of view it has very bad UX.
>
> Please consider trying py.test [2], i bet you will notice difference in
> reporting, and maybe will use it yourself for day-to-day test executions.
> Additionally there is very good
> system for parametrizing tests and writing extensions.
>
> The goal of this letter is to solve problem of CI queues for fuel-web
> project, so please
> share your opinions, It will be nice to solve this at the start of next
> week.
>
> [1] https://review.openstack.org/#/c/82284/3/nailgun/conftest.py
> [2] http://pytest.readthedocs.org/en/2.1.0/
>
> _______________________________________________
> OpenStack-dev mailing list
> OpenStack-dev at lists.openstack.org
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-dev/attachments/20141107/042e691c/attachment.html>


More information about the OpenStack-dev mailing list