Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fsm-lite stops due to lack of RAM #259

Open
hfaoro opened this issue Nov 30, 2023 · 2 comments
Open

fsm-lite stops due to lack of RAM #259

hfaoro opened this issue Nov 30, 2023 · 2 comments
Assignees
Labels

Comments

@hfaoro
Copy link

hfaoro commented Nov 30, 2023

Hello,
I am trying to perform a k-mer analysis using pysser for 6,240 bacterial genomes with binary phenotype. I'm having trouble running fsm-lite. The kmer count is using a lot of RAM and the process does not finish.

I use a Slurm-based cluster to submit jobs, so I need to declare how much memory and cpu my process will use. On the last attempt, I used 500 GB of RAM and it wasn't enough. Any suggestions to overcome this problem? Would increasing the number of cpus help?

@mgalardini
Copy link
Owner

That is a large number of strains indeed! I can suggest trying unitig-counter or bifrost, which should better equipped to handle large datasets

@mgalardini mgalardini self-assigned this Nov 30, 2023
@hfaoro
Copy link
Author

hfaoro commented Nov 30, 2023

Yes, I managed to run the analysis using unitig-caller, but the result of mapping the unitgs to the reference genome using phandango_mapper was strange. Only 80 unitgs were mapped. In another analysis using a smaller data set, kmer's results were very positive, so I was trying to use the same strategy for this larger set.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants