taskcontroller.multiprocess – Multiprocess task controller

The multiprocess task controller creates a pool of processes and runs tasks using them.

Configuration Parameters

multiprocess.poolsize

Number of processes to run concurrently (0 means no limit) default=0

MultiProcessController Class

class pebl.taskcontroller.multiprocess.MultiProcessController(poolsize=None)

Creates a task controller that runs taks on multiple processes.

This task controller uses a pool of processes rather than spawning all processes concurrently. poolsize is the size of this pool and by default it is big enough to run all processes concurrently.

run(tasks)

Run tasks by creating multiple processes.

If poolsize was specified when creating this controller, additional tasks will be queued.