Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Executors to develop #6

Open
1 task done
vsoch opened this issue May 17, 2020 · 1 comment
Open
1 task done

Executors to develop #6

vsoch opened this issue May 17, 2020 · 1 comment

Comments

@vsoch
Copy link
Owner

vsoch commented May 17, 2020

I want to keep a list of executors that I intend to develop, along with random ideas for templates that might be fun.

Executors

  • slurm: should handle qsub commands, and collect the job id and allow the user to get a status, cancel, etc.
  • datalad: per specification of Yarik

Templates

  • timeline is there is any kind of executor that has a temporal aspect, this would be a nice template to use.
@vsoch
Copy link
Owner Author

vsoch commented May 22, 2020

hey @yarikoptic! GitHub is sucking lemons right now so I'm taking a break (and am going to give this poor Octocat some space and time to recover) but I'd like to start developing the ReproNim and Datalad executors now that the skeleton is ready to go! Would you be able to outline the functionality that you'd want for each executor? What I mainly need are the command line and within Python calls you would want to have run as tasks. One thing that isn't implemented (see issue #2) is an ability to run something in a shell and then not wait for it to finish, and have the dashboard query for updates. This will be fairly easy to do if the tool is already async and then has commands/endpoints to get updates, harder to do if it's not. Anyway - leave all the details here! Once I understand how the tools work, I should be able to implement the executor fairly easily. Happy Friday!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant