fix: add quotes to each item of the wait_for_files list

[fdchevalier]

Hello Snakemake team,

Description

Context: Job submission to SGE cluster using qsub from a folder with a path containing a white space.

Problem: First batch of jobs is successfully submitted but snakemake issue an error regarding missing files. Below is the typical error issued when submitting a job from `$HOME/test test/':

Waiting at most 10 seconds for missing files.
Missing files after 10 seconds:
test/.snakemake/tmp.6tq2tga_

The error is due to the absence of quotes around the tmp directory path when generating the job script. The typical line for the the wait-for-files options is as follows:

--wait-for-files /XXXX/test test/.snakemake/tmp.6tq2tga_ test test2 --latency-wait 10 \

but should be:

--wait-for-files '/XXXX/test test/.snakemake/tmp.6tq2tga_' test test2 --latency-wait 10 \

Solution: Add quotes when appending the path to the wait_for_files list.

Comments

The solution has been tested in cases with white space and and with special character (&).

I am not fluent enough in Python so feel free to edit the code if needed.

Minimal reproducible example

In case this needs to be reproduced.

# Create working directory
mkdir "test test"
cd "test test"

# Create status directory for qsub and output directory
mkdir status
mkdir output

# Create test file
touch test

# Create snakefile
cat  << EOF > snakefile
rule test_rule:
    input:
        "test"
    output:
        "output/a.txt"
    shell:
        'sleep 10 && echo h=$(hostname) "{input}" > "{output}"'
EOF

# Submit job
snakemake --cluster "qsub -V -cwd -o status -j y" --jobs 20 -w 10

# Print status
cat status/*

QC

• The PR contains a test case for the changes or the changes are already covered by an existing test case.
• The documentation (docs/) is updated to reflect the changes or this is not necessary (e.g. if the change does neither modify the language nor the behavior or functionalities of Snakemake).

Thank you for considering this patch.

[fdchevalier]

I noticed that the bug was also affecting files with white spaces. So I came with a better solution to quote every item of the wait_for_files list.

I also tested the behavior of Snakemake when having more than 20 elements in the wait_for_lists which creates a file with the list of elements: in that case, the content of the file worked as expected (no need of quotes around each element) but the path to the file required quotes. I modified the code accordingly.

[johanneskoester]

Thanks a lot! Very good idea. Python allows to make the changed code a bit simpler, see below.

[sonarcloud]

Kudos, SonarCloud Quality Gate passed!   

0 Bugs
0 Vulnerabilities
0 Security Hotspots
0 Code Smells

No Coverage information
No Duplication information

[sonarcloud]

Kudos, SonarCloud Quality Gate passed!   

0 Bugs
0 Vulnerabilities
0 Security Hotspots
0 Code Smells

No Coverage information
No Duplication information