Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve project charter #262

Open
romusz opened this issue Jan 4, 2024 · 1 comment
Open

Improve project charter #262

romusz opened this issue Jan 4, 2024 · 1 comment

Comments

@romusz
Copy link

romusz commented Jan 4, 2024

Hello there,

Happy to see Rust community getting into Iceberg.
To help deciding between Icelake, iceberg-rust, and Iceberg-rs, would you mind clarifying how those 3 differ:

  • would your project provide just a reader and writer of Iceberg files (manifest, manifest lists, metadata) or also include integrations with processing and query engines? If so, which ones are considered?
  • is implementation of Iceberg REST catalog in scope for your project?

Thanks a lot!

@romusz romusz changed the title Improved project charter Improve project charter Jan 4, 2024
@Xuanwo
Copy link
Contributor

Xuanwo commented Jan 5, 2024

To help deciding between Icelake, iceberg-rust, and Iceberg-rs, would you mind clarifying how those 3 differ:

All contributors from icelake and iceberg-rs have united under iceberg-rust. Our shared objective is to develop Iceberg Rust upstream. Ultimately, we aim to integrate all existing features of icelake into iceberg-rust.

would your project provide just a reader and writer of Iceberg files (manifest, manifest lists, metadata) or also include integrations with processing and query engines? If so, which ones are considered?

For now, we only have reader and writer support. And in the future, we might provide native datafusion support.

is implementation of Iceberg REST catalog in scope for your project?

Yes, of course. We have implemented REST catalog both in icelake and iceberg-rust.


We recommand you take a look over iceberg-rust first. We are working on iceberg-rust's first release. Welcome to join the development!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants