Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Make Kafka source resilient to broker outages #1713

Open
nkoppisetty opened this issue May 2, 2024 · 0 comments
Open

Make Kafka source resilient to broker outages #1713

nkoppisetty opened this issue May 2, 2024 · 0 comments
Labels
enhancement New feature or request

Comments

@nkoppisetty
Copy link
Member

Summary

What change needs making?
Change in Kafka client to make it resilient to broker outages.

Use Cases

When would you use this?
When a Kafka broker experiences an outage, the Kafka source fails to read incoming messages. It attempts to reconnect to the same broker, causing data loss during the duration of the outage. This issue is common and expected, so it's critical to improve the resilience of the Kafka source to broker outages. By doing so, the Kafka source can continue reading incoming messages during an outage, preventing data loss and ensuring seamless data flow.


Message from the maintainers:

If you wish to see this enhancement implemented please add a 👍 reaction to this issue! We often sort issues this way to know what to prioritize.

@nkoppisetty nkoppisetty added the enhancement New feature or request label May 2, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant