15 Mar
2019
15 Mar
'19
6:06 p.m.
On 3/15/19 4:41 PM, Monty Taylor wrote:
FWIW, we use explicit threads in Zuul and Nodepool and have been very happy with them- since they're explicit and don't require weird monkeypatching.
In sdk, there are a few things that need to be done in the background (when uploading a very large swift object and we're going to split it in to chunks and upload concurrently) In that case we used concurrent.futures.ThreadPoolExecutor which creates a pool of threads and allows you to submit jobs into it ... very simiar to the using-pool-of-workers example above.
This is what we did in the oslo.privsep daemon too when we added parallel execution.