Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: WDL overhaul for Dockstore and Terra #1005

Open
5 of 8 tasks
j23414 opened this issue Sep 26, 2022 · 0 comments
Open
5 of 8 tasks

feat: WDL overhaul for Dockstore and Terra #1005

j23414 opened this issue Sep 26, 2022 · 0 comments
Assignees
Labels
enhancement New feature or request

Comments

@j23414
Copy link

j23414 commented Sep 26, 2022

Description

In order to document and test the Terra WDL workflows, this issue outlines a somewhat major overhaul of WDL code.

To stop maintaining 3 separate GitHub branches for genbank_ingest, gisaid_ingest, and ncov; the code is refactored to using Dockstore subworkflows as discussed in this slack thread.

After some quick discussions with @huddlej , a proposed order of operations is listed below. Dockstore will only surface subworkflows on the master branch so documentation cannot "point to latest entry points" until the master .dockstore.yml is updated. Afterwards, new branches with the same .dockstore.yml will become available for future development.

Order of Operations

  • Surface the Dockstore subworkflows entries, which requires the following merge:
    • merge wdl/ingest_squash branch, which will merge the new .dockstore.yml and surface the subworkflows
    • delete the then redundant separate branches wdl/genbank_ingest and wdl/gisaid_ingest
  • Update wdl/docs branch to point to the surfaced Dockstore subworkflows
  • Tag a few beta testers to work through the wdl/docs and run subworkflows
  • Address any comments and suggestions
  • Merge wdl/docs (Update: TERRA Workflow Documentation #999)
  • Migrate current users of wdl/ncov branch to master, and delete wdl/ncov branch

Any edits to WDL files and reStructuredText files should not affect the Snakemake workflows and should have limited side effects. Of course open to discussion/suggestions.

@j23414 j23414 added the enhancement New feature or request label Sep 26, 2022
@j23414 j23414 self-assigned this Sep 26, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
No open projects
Status: In Progress
Development

No branches or pull requests

1 participant