-
-
Notifications
You must be signed in to change notification settings - Fork 155
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Support force using ListOffsetsRequest to fetch offset #699
Comments
The main issue is that method |
draft:#700 |
Update: using param to force |
Why is the provider returning the ApiKey for OffsetsForLeaderEpoch in the ApiVersions response? |
Yes, I am also extremely puzzled as to why Alibaba would construct an ApiVersions response with a fake value. However, from the logs, I found that the reason for resetting was because the endoffset was 0, which led to the consumer consuming repeatedly (auto.reset.offset). At the same time, I also confirmed with their technical support to understand whether this interface was working correctly internally. But the response I received was that they do not support this interface. |
Can you file a ticket with Alibaba with evidence they are supporting the API? Also, I think we can avoid your feature for now -- what do you think about using a |
Sorry for the delayed reply, I meant to post this much sooner. What I mean is, rather than introducing a whole new config option to disable OffsetForLeaderEpoch, why don't you do something like this? func main() {
v := kversion.Stable()
v.SetMaxKeyVersion(kmsg.OffsetForLeaderEpoch.Int16(), -1)
cl, err := kgo.NewClient(
kgo.MaxVersions(v), This will opt out of the offset for leader epoch key (I think) |
Yep. I think this option will help correct the wrong behavior. But after rethinking, what if those Cloud-Providers implement a "fake" Kafka protocol based on their claimed specific version? Rolling back the version may not be a good idea. But Thanks you reply. |
Why have this proposal
Some cloud service providers (such as alibabacloud) haven't implemented OffsetsForLeaderEpoch.
What happened
Franz-go uses
OffsetsForLeaderEpoch
to fetch leader epoch/End Offset and compare consumer offset between leader. After restart, will trigger reset offset behaviour.Log
The text was updated successfully, but these errors were encountered: