Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Incomplete external offset storage #1414

Open
LeifW opened this issue Sep 5, 2021 · 0 comments
Open

Incomplete external offset storage #1414

LeifW opened this issue Sep 5, 2021 · 0 comments

Comments

@LeifW
Copy link

LeifW commented Sep 5, 2021

In your example for external offset storage, using plainSource, a single partition is assigned. I'm guessing it's common to subscribe to multiple partitions in one subscription? For those cases, I'm wondering about the edge case where some partitions had no offset saved before the system shut down. I think for those partitions, they should start wherever the "auto offset reset" setting dictates? Which is what plainPartitionedManualOffsetSource does.
Is there any way to subscribe to multiple partitions with plainSource, and only have a starting offset for some of them (i.e. skip the .seek call on the others?)
https://doc.akka.io/docs/alpakka-kafka/current/consumer.html#offset-storage-external-to-kafka

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant