Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clarify memory usage limiting in case of --metadata-ttl enabled #864

Open
mhnap opened this issue May 2, 2024 · 1 comment
Open

Clarify memory usage limiting in case of --metadata-ttl enabled #864

mhnap opened this issue May 2, 2024 · 1 comment

Comments

@mhnap
Copy link

mhnap commented May 2, 2024

I have another question about --metadata-ttl following #855. Now it's explicitly possible to set --metadata-ttl to indefinite value. As I understand it's the same as setting the max value manually. But indefinite is even mentioned in the documentation, making it an expected usage. So, I have a question is there some logic implemented for memory usage limiting while using --metadata-ttl=indefinite? I don't know how much memory can be used by metadata caching for big buckets, but it's quite possible that there could be billions of objects inside. I would be grateful to know whether some memory liming logic exists or it's expected to grow indefinitely.

Thanks for fixing and documenting cache features!

@monthonk
Copy link
Contributor

monthonk commented May 8, 2024

Hey, currently the kernel can call forget to remove a reference for an inode in mountpoint and we will remove that inode from the heap once there is no reference left. This mechanism relies on the kernel to free up some memory, so there is no guarantee that your memory usage would not grow. However, we are considering to add a new memory limiting mechanism in the future and we will make sure to update our doc for metadata accordingly.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants