Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

how to use multiple threads with using this library for better speed of reading fastq files ? #137

Open
lidd77 opened this issue Jan 22, 2020 · 1 comment

Comments

@lidd77
Copy link

lidd77 commented Jan 22, 2020

Hi,
In order to improve the speed of reading fastq files and doing some quality control statistics , wanna
use multiple threads to complete some statistics of every four fastq lines from the FASTQ files .
so could you recommend some methods/codes to realize that goal ?
it's very slow to read fastq files in the way line by line .

Best!

@ahcm
Copy link

ahcm commented Jan 22, 2020

Read in big chunks in main thread. Process in memory in parallel.

Probably not worth optimization: let main thread distribute the chunks to the fitting numa nodes.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants