parallel running: added Dask support #72
Open
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This solves #63
Few notes:
time.sleep(1)
to make the example's fitness calculation slower.try
block, and behave accordingly.Usage:
executor='dask'
argument toSimpleEvolution
-- Local - run parallel on local machine CPU's. This mode will be used automatically if nothing further is done. If user wishes to configure exact behaviour, see example below.
-- Cluster - run parallel using Slurm (or similar LSF facilities) - the Slurm cluster need to be configured with few code lines.
max_workers
is ignored if Dask is usedExample: