Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Batch-mode Pulsar #250

Open
Tracked by #12399
jmchilton opened this issue Apr 5, 2021 · 0 comments
Open
Tracked by #12399

Batch-mode Pulsar #250

jmchilton opened this issue Apr 5, 2021 · 0 comments

Comments

@jmchilton
Copy link
Member

jmchilton commented Apr 5, 2021

The two container job pod approach to Pulsar is very similar to the prior work that targeting Apache Mesos with Pulsar. Generalizing this approach one can imagine creating a batch script that setup a Pulsar application in this modality and takes care of staging files in and out, cancelling, etc.. This script could then be qsub-ed and used as a server-less Pulsar to really increased the distributed nature of Pulsar. This would be useful for usegalaxy.org and could enable things such as Condor Flocking, etc..

This would be an important piece of work for fully utilizing the power of iRODS on usegalaxy.org also.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant