Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support time based retention #17413

Draft
wants to merge 15 commits into
base: master
Choose a base branch
from
Draft

Support time based retention #17413

wants to merge 15 commits into from
+472 −159

Commits on May 28, 2024

  1. Add charts 

    Rename options
Global backfill
Metadata calculation (percentage)
Retention timer
Adjust time
Calculate iterations
Update every is less than 60 and divisor of 60
    @stelfrag
    stelfrag committed May 28, 2024
    Configuration menu
    Copy the full SHA
    b9315f9 View commit details
    Browse the repository at this point in the history

  2. Add option to specify time retention 

    dbengine tier x retention days
Switch to dbengine tier x disk space MB
Fix grouping iterations
    @stelfrag
    stelfrag committed May 28, 2024
    Configuration menu
    Copy the full SHA
    5645754 View commit details
    Browse the repository at this point in the history

  3. Allow disk space to be 0 (unlimited) 

    Assume retention to be the one specified with time
Sane value for maximum datafile target size if max disk space is 0
    @stelfrag
    stelfrag committed May 28, 2024
    Configuration menu
    Copy the full SHA
    4c66cde View commit details
    Browse the repository at this point in the history

  4. Test configured disk space to be total free space - 10% 

    Rework human readable retention and expected retention in nodes_instances api
    @stelfrag
    stelfrag committed May 28, 2024
    Configuration menu
    Copy the full SHA
    790db89 View commit details
    Browse the repository at this point in the history

  5. Further fix on human readable retention 

    If no time restriction is specified, use disk space calculated one
    @stelfrag
    stelfrag committed May 28, 2024
    Configuration menu
    Copy the full SHA
    eaca8a2 View commit details
    Browse the repository at this point in the history

  6. Remove dbengine parallel initialization option 

    Remove duplicate, commented out code
    @stelfrag
    stelfrag committed May 28, 2024
    Configuration menu
    Copy the full SHA
    6ff75f8 View commit details
    Browse the repository at this point in the history

  7. Allow tier disk space to be 0 in which case the current disk space av… 

    …ailable will be used for calculations
    @stelfrag
    stelfrag committed May 28, 2024
    Configuration menu
    Copy the full SHA
    2963139 View commit details
    Browse the repository at this point in the history

  8. Proper calculation of iterations 

    Support seconds in human duration representation
Remove commented out code
Create tiers as needed
    @stelfrag
    stelfrag committed May 28, 2024
    Configuration menu
    Copy the full SHA
    36750b6 View commit details
    Browse the repository at this point in the history

  9. Function to return sqlite database space 

    Compile with disable-ml properly
Do proper time retention check
Temporary additional info in node_instances api
    @stelfrag
    stelfrag committed May 28, 2024
    Configuration menu
    Copy the full SHA
    174e004 View commit details
    Browse the repository at this point in the history

  10. Do not account for metadata size if old settings are detected

    @stelfrag
    stelfrag committed May 28, 2024
    Configuration menu
    Copy the full SHA
    15bc343 View commit details
    Browse the repository at this point in the history

  11. Consider regacy tier multihost disk space MB settings as well

    @stelfrag
    stelfrag committed May 28, 2024
    Configuration menu
    Copy the full SHA
    42b407c View commit details
    Browse the repository at this point in the history

  12. Adjust time retention calculation

    @stelfrag
    stelfrag committed May 28, 2024
    Configuration menu
    Copy the full SHA
    fe7fa9c View commit details
    Browse the repository at this point in the history

  13. Cleanup / allow 5% free disk space when all disk is to be used just t… 

    …o be safe
    @stelfrag
    stelfrag committed May 28, 2024
    Configuration menu
    Copy the full SHA
    786ce13 View commit details
    Browse the repository at this point in the history

  14. Update some defaults

    @stelfrag
    stelfrag committed May 28, 2024
    Configuration menu
    Copy the full SHA
    b8281cb View commit details
    Browse the repository at this point in the history

  15. Use default 1024 MB for each tier 

    Add new dbengine tier 0 multihost disk space MB
Time based retention defaults to disabled if all parameters are default
    @stelfrag
    stelfrag committed May 28, 2024
    Configuration menu
    Copy the full SHA
    0259ebe View commit details
    Browse the repository at this point in the history