Skip to content
This repository was archived by the owner on Sep 11, 2023. It is now read-only.
This repository was archived by the owner on Sep 11, 2023. It is now read-only.

In Manager use multiprocessing.Pool not ProcessPoolExecutor #325

Closed
@JackKelly

Description

@JackKelly

We probably want the worker processes to be demonic.

If that's not possible then maybe have Manager only send a single batch to each process at a time (so the workers will terminate faster)

noxdafox/pebble#76 suggests that ProcessPoolExecutor is not demonic, whilst multiprocessing.Pool is demonic

https://stackoverflow.com/questions/56237493/how-to-make-tasks-in-processpoolexecutor-behave-like-daemon-process suggests we should be using multiprocessing.Pool

Metadata

Metadata

Assignees

Labels

bugSomething isn't working

Type

No type

Projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions