-
Notifications
You must be signed in to change notification settings - Fork 189
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add support Clickhouse database as source and sink #342
Comments
FWIW, if your data is already on Kafka, it's trivial to sync
that said, syncing Arroyo stream to Clickhouse without Kafka would be cool indeed for long-term storage. |
What would the high-level design be for implementing this feature and testing procedure? |
Clickhouse has various integrations for data ingestions, Kafka as mentioned above is just one of them. I'm no expert but maybe any of these https://clickhouse.com/docs/en/integrations -> search for "Data ingestion" work well together with what Arroyo.dev already has. |
Maybe try remote select? Something like:
CH Docs: With that in place, you can simply run a remote insert into a ClickHouse table via the tcp protocol. This might be easier and faster to implement than a full-blown integration. |
It will be great if Arroyo also will be able to work with Clickhouse.
The text was updated successfully, but these errors were encountered: