Is it feasible to leverage AWS Batch to parallelize the processing of individual files within a folder? #4866
Unanswered
Ankita-1211
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I understand that with AWS Batch as the executor, it's possible to simultaneously run various independent processes of the same workflow on different compute resources in parallel.
Is it feasible to leverage AWS Batch to parallelize the processing of individual files within a folder?
For example, if we have a FastQC process that analyzes five files in a directory, can each file be processed concurrently on separate compute instances?
Beta Was this translation helpful? Give feedback.
All reactions