Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Are there file serialization formats for HTM, Q3C that would be worth make Sparse versions for? #128

Open
wmwv opened this issue May 16, 2022 · 0 comments

Comments

@wmwv
Copy link
Contributor

wmwv commented May 16, 2022

Pardon, this is a bit off topic, but are there file serialization formats for storing data with HTM or Q3C indexing with some fast-access pattern? I'm familiar with them in databases but have not been able to find a serialized file format implementation aimed at performance.

E.g., sure, you can save them as a column in a Parquet file and load that into an dataframe with the trixel/pixel number as an integer, but that doesn't take advantage of the structure of the numbering scheme when doing things like nearest neighbor or region lookups.

The relevance here is would a HealSparse equivalent be worth developing for those?

@wmwv wmwv changed the title Are there file serialization formats for HTM, Q3C? Are there file serialization formats for HTM, Q3C that would be worth make Sparse versions for? May 16, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant