Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support reading records in roaringbitmap from iteratively serialized persistent files #604

Open
KeeProMise opened this issue Dec 12, 2022 · 2 comments

Comments

@KeeProMise
Copy link

Is your feature request related to a problem? Please describe.
When we serialize a roaringbitmap to disk, we should design a method of iteratively reading records from disk, so that we don't have to read all the records at once, which is more friendly to memory.

Describe the solution you'd like
You can design a new class called diskroaringbitmap, or roaringbitmapreader, or directly add a method of iteratively reading records from disk files to the existing roaringbitmap.

Please note that this is a community-based project. Consider proposing a fix (code, documentation) as a pull request.

@larsk-db
Copy link
Contributor

Sounds like this is what you are looking for? https://github.com/RoaringBitmap/RoaringBitmap#working-with-memory-mapped-bitmaps

@lemire
Copy link
Member

lemire commented Dec 12, 2022

@larsk-db is correct... what you are probably looking for are memory-mapped bitmaps.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants