Skip to content
This repository has been archived by the owner on Apr 2, 2024. It is now read-only.

Better defaults for cache sizes #1716

Open
niksajakovljevic opened this issue Oct 24, 2022 · 3 comments
Open

Better defaults for cache sizes #1716

niksajakovljevic opened this issue Oct 24, 2022 · 3 comments
Assignees
Labels
epic/better-defaults epic/out-of-the-box Improving Promscale out of the box experience Performance Improvements that are specifically related to performance

Comments

@niksajakovljevic
Copy link
Contributor

To achieve good performance we are currently recommending our users to tweak following:

--metrics.cache.series.initial-size=30000000
--cache.memory-target=90% 

Let's make sure that cache memory defaults work well enough out of the box. Cache tweaks should be only used for extreme cases.
We should validate our findings/improvements by running benchmarks.

@niksajakovljevic niksajakovljevic added Performance Improvements that are specifically related to performance epic/out-of-the-box Improving Promscale out of the box experience labels Oct 24, 2022
@niksajakovljevic niksajakovljevic self-assigned this Oct 24, 2022
@niksajakovljevic
Copy link
Contributor Author

Fixes in #1705 mean that great majority of users shouldn't have to tweak metrics.cache.series.initial-size .
Benchmark numbers look pretty good now with default settings so cache.memory-target can stay the same.

@niksajakovljevic
Copy link
Contributor Author

Reopening issue to validate existing DefaultSeriesCacheSize = 250000 setting which seems low.

@niksajakovljevic
Copy link
Contributor Author

Base on memory heap profile existing DefaultSeriesCacheSize = 250000 uses around 70MB. Maybe we should reconsider increasing it to 500K or maybe even 1M? (140MB or 280MB)? That would make defaults more appropriate for realistic data loads and would mean less overhead of growing cache. @VineethReddy02 What are your thoughts?

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
epic/better-defaults epic/out-of-the-box Improving Promscale out of the box experience Performance Improvements that are specifically related to performance
Projects
None yet
Development

No branches or pull requests

1 participant