Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve db-memory #2377

Open
6 tasks
ineiti opened this issue Sep 23, 2020 · 0 comments
Open
6 tasks

Improve db-memory #2377

ineiti opened this issue Sep 23, 2020 · 0 comments
Projects

Comments

@ineiti
Copy link
Member

ineiti commented Sep 23, 2020

As it doesn't seem to be possible to reduce bbolt's memory usage, one should reduce the number of lookups:

  • remove stateChangeStorage.calculateSize and all related size-handling of the db
  • GetAllSkipchains and GetAllSkipchainIDs should not crawl through every block, but rather depend on a new table that holds all skipchains
  • find the last places where new byzcoin-dbs are created
  • use skipBlockShort for all methods, like SkipBlockDB.GetSingleBlockByIndex and others
  • check if there are other places where the whole chain is crawled and all blocks are loaded into memory (db.Stats() or db.Status())
  • eventually clean up the chain and drop unused blocks
@ineiti ineiti added this to TODO in Cothority via automation Sep 23, 2020
@ineiti ineiti moved this from TODO to WIP in Cothority Sep 23, 2020
@ineiti ineiti moved this from WIP to TODO in Cothority Sep 23, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Cothority
  
TODO
Development

No branches or pull requests

1 participant