Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Lower zstd compression ratio for non-sealed leafs #102

Open
rklaehn opened this issue Jun 15, 2021 · 0 comments
Open

Lower zstd compression ratio for non-sealed leafs #102

rklaehn opened this issue Jun 15, 2021 · 0 comments

Comments

@rklaehn
Copy link
Contributor

rklaehn commented Jun 15, 2021

zstd compression at high levels is not cheap. So it seems that it is only worth it for things that we will keep for a long time.

Non-sealed branches are usually kept around only for a short time. So it would be possible to significantly speed up write ops by just using a lower zstd level for non-sealed branches.

For leafs it is tricky, since we don't know whether a leaf will be sealed before starting to compress things. But on average you got more branches than leaves when doing an update, so doing this for branches will have most of the benefit.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant