Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Is there a way to keep overgoal chunks until free space falls below a threshold? #919

Open
dagelf opened this issue Apr 20, 2022 · 1 comment

Comments

@dagelf
Copy link

dagelf commented Apr 20, 2022

Say you had a chunkserver or two missing, and a lot of data got replicated... now you re-add those chunkservers. Work has already been done and your data is now more secure... why undo it? Can you keep it without having to run a script to manually re-goal each chunk? And without having to wear your drives by increasing the goal on other files.

@dagelf
Copy link
Author

dagelf commented May 7, 2022

The reason this is an issue, is that if a chunkserver goes down, chunks get replicated, which is good... but then when the chunkserver comes back up, the chunks get deleted- and while this is ongoing, throughput drops to below 1MB/s presumably because of RAM/CPU constraints on my chunkservers. Putting chunkservers that has gone down in maintenance mode when they are restored, temporarily alleviates the problem.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant