Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Get the data from eclipse hono to apache IoTDB/ Tdengine - cloud2edge package #520

Open
suhas04s9 opened this issue Dec 26, 2023 · 1 comment

Comments

@suhas04s9
Copy link

I'm currently working on a project that involves integrating Eclipse hono with Apache IoTDB or Tdengine (or any other suitable DB if not possible in these two). I need to transfer data from Eclipse hono to DB to leverage its time-series data storage and analysis capabilities. However, I couldn't find any direct integration options between the two platforms.

I would appreciate guidance on the best approach to achieve this data transfer. Specifically, I want to understand how to:

1.Connect and establish communication between Eclipse hono and DB.(using internal kafka or external kafka)
2.Implement a data ingestion mechanism to transfer real-time data from hono to DB using kafka.
3.Retrieve historical data from DB and expose it through Ditto.

@thjaeckle
Copy link
Contributor

thjaeckle commented Jan 2, 2024

Hi @suhas04s9

I would have used Ditto to relay messages into IoTDB's built in MQTT broker. Optionally applying payload mapping in Ditto, if needed.

But doing it directly via Hono's Kafka topics would of course be more efficient.
I am not an expert on IoTDB, but I expect that a certain format is required for the infested data.

So you either need to produce that format already before sending it to hono or use a Hono custom mapper: https://eclipse.dev/hono/docs/admin-guide/mqtt-adapter-config/#custom-message-mapping

So you have some options, I would be interested in the solution you come up with.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants