Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature request: Add support for xz and zstd #383

Open
outpaddling opened this issue Jun 21, 2023 · 0 comments
Open

Feature request: Add support for xz and zstd #383

outpaddling opened this issue Jun 21, 2023 · 0 comments

Comments

@outpaddling
Copy link

xz offers far better compression than gzip (up to 40% for many sequence files) and decompression is about as fast. Compression is slow, so I only recommend it for long-term files. E.g., I use xz for raw data and final results.

zstd offers compression similar to gzip while using far less CPU time. I recommend this for temporary files.

FWIW, lz4 is even faster than zstd, but does not provide comparable compression. I'm not sure it's worth supporting, but something to consider. zstd CPU time is pretty low, so there isn't much advantage to improving on it in general.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant