Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Sparse tdb_cons_add() #125

Open
tuulos opened this issue Mar 11, 2017 · 0 comments
Open

Sparse tdb_cons_add() #125

tuulos opened this issue Mar 11, 2017 · 0 comments
Labels
cons-enhancement

Comments

@tuulos
Copy link
Member

tuulos commented Mar 11, 2017

Currently tdb_cons_add() writes intermediate events to disk with all fields encoded as an 64-bit item, even the ones with an empty value. This ends up taking a lot of disk space with a large number of (sparse) fields.

This shouldn't be necessary. Fixing this should make both tdb_cons_add() and tdb_cons_finalize() faster due to lower IO load.
tuulos pushed a commit to tuulos/traildb that referenced this issue May 29, 2017
implmenet sparse tdb_cons_add - only store fields with non-zero values
88395c4 
addresses issue traildb#125.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
cons-enhancement
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@tuulos