Open Stack

Hi,

We are using taskflow to execute workflows. Each workflow is executed by a
separate thread (using engine.run() method). This is limiting our
capability to execute maximum number of workflows that can run in parallel.
It is limited by the number of threads there in the thread pool.

Most of the time, the workflow tasks are run by agents which could take
some time to complete. Each engine is alive and runs on a dedicated thread.

Is there any way to reuse or run multiple engines on one thread. The
individual tasks of these engines can run in parallel.

I came across iter_run method of the engine class. But not sure if that can
be used for this purpose.

Any help is highly appreciated.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-discuss/attachments/20200226/9b983641/attachment-0001.html>