tkp.distribute
– routines for running on distributed nodes¶
tkp.distribute implement various computation distribution methods. All sub modules should communicate with the other parts of TKP through the tkp.steps submodule.
-
class
tkp.distribute.
Runner
(distributor, cores=0)[source]¶ Bases:
object
Parameters: distributor – the name of the distribution method, example multiproc
A computation distribution implementation using the build in multiprocessing module. the Pool.map function only accepts one argument, so we need to zip the iterable together with the arguments.