Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Parallel MCMC does not work on distributed memory systems #39

Open
prmiles opened this issue Apr 30, 2019 · 0 comments
Open

Parallel MCMC does not work on distributed memory systems #39

prmiles opened this issue Apr 30, 2019 · 0 comments
Assignees

Comments

@prmiles
Copy link
Owner

prmiles commented Apr 30, 2019

Is your feature request related to a problem? Please describe.
The ParallelMCMC feature does not work on distributed memory systems. It works fine on my computer, but it is not suitable for use on a cluster. For example, I request for cores on the cluster, run ParallelMCMC, and it runs each MCMC serially on the same core, meaning it takes four times longer than it should.

Describe the solution you'd like
Implement ParallelMCMC using a parallel package compatible with multiple nodes. The multiprocessing.Pool method is convenient, but inappropriate in this context.

Describe alternatives you've considered
The ParallelMCMC module is essentially just a wrapper for running individual MCMC cases, so you can certainly run multiple individual jobs on a cluster.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant