This repository was archived by the owner on Sep 11, 2023. It is now read-only.
This repository was archived by the owner on Sep 11, 2023. It is now read-only.
In Manager
use multiprocessing.Pool
not ProcessPoolExecutor
#325
Closed
Description
We probably want the worker processes to be demonic.
If that's not possible then maybe have Manager only send a single batch to each process at a time (so the workers will terminate faster)
noxdafox/pebble#76 suggests that ProcessPoolExecutor is not demonic, whilst multiprocessing.Pool is demonic
https://stackoverflow.com/questions/56237493/how-to-make-tasks-in-processpoolexecutor-behave-like-daemon-process suggests we should be using multiprocessing.Pool