Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

In-memory-Engine: memory usage metrics and overhead reduction #16817

Open
tonyxuqqi opened this issue Apr 12, 2024 · 0 comments
Open

In-memory-Engine: memory usage metrics and overhead reduction #16817

tonyxuqqi opened this issue Apr 12, 2024 · 0 comments
Labels
type/enhancement Type: Issue - Enhancement

Comments

@tonyxuqqi
Copy link
Contributor

tonyxuqqi commented Apr 12, 2024

Currently the in-memory-engine's memory consumption is much more than block cache.
In this case, when in-memory-engine is disabled, the block cache size is 8.4GB (That's all data cached). But when the in-memory-engine is enabled, the memory usage by in-memory-engine is more than 30GB, about 4x of block cache size.

The possible reason is that eviction is not implemented and there're some follower region's data in the in-memory-cache. But we need a clear metrics to show the memory usage, cached key count, cached region count, etc.
Screen Shot 2024-04-11 at 5 45 49 PM

@tonyxuqqi tonyxuqqi added the type/enhancement Type: Issue - Enhancement label Apr 12, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type/enhancement Type: Issue - Enhancement
Projects
None yet
Development

No branches or pull requests

1 participant