GCP error in v.3.4.1 "Cloud Storage objects are immutable"

[lescai]

Description of the bug

Got the error:

Apr-24 16:07:17.072 [Actor Thread 40] ERROR nextflow.extension.OperatorImpl - @unknown
com.google.cloud.storage.contrib.nio.CloudStorageObjectImmutableException: Cloud Storage objects are immutable.
	at com.google.cloud.storage.contrib.nio.CloudStorageFileAttributeView.setTimes(CloudStorageFileAttributeView.java:65)
	at java.base/java.nio.file.CopyMoveHelper.copyToForeignTarget(CopyMoveHelper.java:135)
	at java.base/java.nio.file.CopyMoveHelper.moveToForeignTarget(CopyMoveHelper.java:157)
	at java.base/java.nio.file.Files.move(Files.java:1435)
	at nextflow.file.SimpleFileCollector.saveFile(SimpleFileCollector.groovy:102)
	at nextflow.file.FileCollector.saveTo0(FileCollector.groovy:228)

the pipeline has been launched with a very simple test command (I’ve hidden some parts of the identifiers).
conversation in Slack:
https://nfcore.slack.com/archives/C05V9FRJYMV/p1713976551898249

Command used and terminal output

nextflow run nf-core/sarek -c ../***_profile.config -profile gls,test --outdir .

profiles {
    gls {
        process.executor = 'google-batch'
        workDir = 'gs://****-data/work'
        google.location = 'europe-west4'
        google.region  = 'europe-west4'
        google.project = '*****'
        google.batch.usePrivateAddress = 'true'
        google.batch.spot = true
        fusion.enabled = true
        wave.enabled = true
        process.scratch = false
    }
}
process {
  errorStrategy = { task.exitStatus in [1,143,137,104,134,139,255,108] ? 'retry' : 'finish' }
  maxRetries = 4
  maxErrors = '-1'
}

Relevant files

No response

System information

Google Cloud Batch
nf-core/sarek v3.4.1-gea88402
nextflow 23.10.1
same error when launched from GCP console CLI or when launched from a small VM with CentOS 7

[ejseqera]

The error comes from this invocation of collectFile which was introduced by an update to the template. Removal of sort: false option results in a successful run, but I don't think we actually want to be enforcing ordering.

        ch_multiqc_files                      = ch_multiqc_files.mix(ch_methods_description.collectFile(name: 'methods_description_mqc.yaml', sort: false))