Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

HTCondor executor #23

Open
mih opened this issue May 23, 2020 · 1 comment
Open

HTCondor executor #23

mih opened this issue May 23, 2020 · 1 comment

Comments

@mih
Copy link

mih commented May 23, 2020

This is not an actual issue. I just wanted to share that I have looked at qme and it looks as if it would plug a whole that I have not attempted to fill in https://github.com/datalad/datalad-htcondor. This is a (presently) stalled prototype of a DataLad extension to execute datalad run style commands via HTCondor, and have the execution graph be reflected in the Git history of a dataset repository.

When I get back to this project, I will make a concrete attempt to use qme for the job tracking aspect. If my understanding of the system is somewhat valid, this might yield an HTCondor executor for qme.

@vsoch
Copy link
Owner

vsoch commented May 23, 2020

This sounds great! If you want some help, if you write out the flow that you'd want (and actions) I can give a shot at a skeleton, although I don't have a cluster that I could test on. I'll point you to this guide https://vsoch.github.io/qme/tutorials/create-executor/ for the thinking process I went through when adding the slurm executor.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants