Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[question] limit memory kraken2 #458

Open
egenomics opened this issue Oct 5, 2023 · 5 comments
Open

[question] limit memory kraken2 #458

egenomics opened this issue Oct 5, 2023 · 5 comments
Labels
question Further information is requested

Comments

@egenomics
Copy link

Hi,
I am trying to run kraken2 on a machine with 50Gb RAM.

bactopia -profile singularity --wf kraken2 \
  --bactopia /home/jlvillanueva/Documents/SALMONELLA/bactopia_v3_results \
  --kraken2_db /home/jlvillanueva/bactopia/kraken_db/k2_pluspf_20221209.tar.gz \
  --include includes.txt --max_cpus 4 \
  -qs 2 \
  --max_memory 16

However my system crashes as it tries to use more memory than specified as you can see in this screenshot. Am I doing something wrong? Can kraken2 be limited by another means?

Thanks in advance.
Screenshot from 2023-10-05 12-29-54

@egenomics egenomics added the question Further information is requested label Oct 5, 2023
@rpetit3
Copy link
Member

rpetit3 commented Oct 5, 2023

You were correct in using --max_memory 16. I know with Docker, Nextflow will make sure the job doesn't go over 16 gb.

Let me see if it does the same for Singularity.

@egenomics
Copy link
Author

It doesn't, in the screenshot you can see that is using more than 16Gb per job and crashes.

@rpetit3
Copy link
Member

rpetit3 commented Oct 6, 2023

Did you also test with Docker?

@egenomics
Copy link
Author

No, we can't use docker at the hospital for several internal reasons.

@rpetit3
Copy link
Member

rpetit3 commented Oct 18, 2023

Good to know, I was aware of Docker sticking to the asked resource allocation (it kills jobs if memory is exceeded). I had only assumed Singularity did the same. Thank you for the info

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

2 participants