Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Executing workflow from argument file with provenance not working as expected #1843

Open
jjkoehorst opened this issue May 18, 2023 · 0 comments

Comments

@jjkoehorst
Copy link
Contributor

Expected Behavior

When executing a workflow with the workflow in the argument yaml file using cwl:tool: works as expected.
When executing it with --provenance PROV the provenance should show all files and provenance elements.

Actual Behavior

However when executing it with --provenance PROV the provenance does not show any individual workflow files.

To explain it a bit in more detail...

When running the workflow using local cwl files it works

cwltool --outdir OUT --provenance PROV ../workflows/workflow_longread_quality.cwl longread_quality/no_kraken.yaml

find PROV | grep "cwl$"                                                                                          
PROV/snapshot/workflow_prepare_fasta_db.cwl
PROV/snapshot/minimap2_to_fastq.cwl
PROV/snapshot/filtlong.cwl
PROV/snapshot/pigz.cwl
PROV/snapshot/prepare_fasta_db.cwl
PROV/snapshot/array_to_file.cwl
PROV/snapshot/krona.cwl
PROV/snapshot/files_to_folder.cwl
PROV/snapshot/nanoplot.cwl
PROV/snapshot/workflow_longread_quality.cwl
PROV/snapshot/concatenate.cwl
PROV/snapshot/kraken2.cwl
PROV/workflow/packed.cwl

When running it like

cwltool --outdir OUT --provenance PROV https://gitlab.com/m-unlock/cwl/-/raw/master/workflows/workflow_longread_quality.cwl longread_quality/no_kraken.yaml

find PROV | grep "cwl$"
PROV/workflow/packed.cwl

it does not show the individual cwl files. Neither when executing it like

cwl:tool: ../../workflows/workflow_longread_quality.cwl
# cwl:tool: https://gitlab.com/m-unlock/cwl/-/raw/master/workflows/workflow_longread_quality.cwl
identifier: TEST
readtype: Nanopore
fastq_rich: true
threads: 6
memory: 4000
longreads:
   - class: File
     location: http://download.systemsbiology.nl/unlock/cwl/test_data/ont_guppy_reads.fq.gz
filter_references:
   - class: File
     location: http://download.systemsbiology.nl/unlock/cwl/test_data/human_small.fa.gz

find PROV | grep "cwl$"
PROV/snapshot/workflow_longread_quality.cwl
PROV/workflow/packed.cwl

Workflow Code

# cwl:tool: <Depending on the type of run>
identifier: TEST
readtype: Nanopore
fastq_rich: true
threads: 6
memory: 4000
longreads:
   - class: File
     location: http://download.systemsbiology.nl/unlock/cwl/test_data/ont_guppy_reads.fq.gz
filter_references:
   - class: File
     location: http://download.systemsbiology.nl/unlock/cwl/test_data/human_small.fa.gz

Your Environment

  • cwltool version: 3.1.20230513155734
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant