New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

deploy snapdb to production on s1/2/3 nodes #4171

Open

2 tasks

LeoHChen opened this issue May 17, 2022 · 0 comments

Assignees

Labels

Contributor

LeoHChen commented May 17, 2022

snapdb reduces the disk space from 3t to about 250g. it can be used on all s1/2/3 nodes. And it's a huge reduce of the disk and cost.

we need to rollout the snapdb to all our internal nodes on s1/2/3. the following actions are needed.

setup weekly snapdb generation automation. To generate the snapdb will take a few days, so we can use two nodes to rotate the generation work. generation and auto-upload to an s3 bucket.
do a monthly replacement of the s0 db with snapdb, on s1/2/3 nodes. so that the disk requirement of the nodes on s1/2/3 won't increase that much. please enable deep pruning on those nodes as well. we can keep the disk size of the nodes in s1/2/3 to 1T.

LeoHChen added the enhancement label

LeoHChen assigned tahir59

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment