Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Demystify ConsumerRebalanceListener for specific cases #1

Open
zhenik opened this issue Mar 21, 2019 · 0 comments
Open

Demystify ConsumerRebalanceListener for specific cases #1

zhenik opened this issue Mar 21, 2019 · 0 comments

Comments

@zhenik
Copy link

zhenik commented Mar 21, 2019

Requirements:

  1. Consumer properties enable.auto.commit:false
  2. Commit offset after processing or last processed record(s)

Does ConsumerRebalanceListener can be useful in these cases:

  1. The first risk is the delay in next pool, because you are busy processing data from the last call. If you don't poll for a long, the group coordinator might assume that you are dead and trigger a rebalance activity. You don't want that to happen, Right? Because you were not dead, you were computing.
  2. The second risk is also related to rebalancing. The coordinator triggers a rebalance activity for some other reason while you are processing an extensive list of messages.

All cases with solution described HERE

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant