Kafka: client has run out of available brokers

[logic-building]

Problem Description: (Not issue with latest sarama and latest kafka)
I get the error:
Kafka: client has run out of available brokers.
Version:
with kafka version : 2.11-1.0.0 and
sarama version 1.43.2

and fix is 1.40.0 sarama version . Just wanted make note somewhere.

And I don't see this issue at all with latest kafka and latest sarama.
kafka: 2.13_3.2.3
sarama: 1.43.2

[puellanivis]

Wait, what? We recently ran into this, and we were using v1.42.1… what change could have resolved this?

[dnwe]

@puellanivis I'm not sure if its the same for you, but in @logic-building 's case I think this is just a scenario of not pinning an explicit KafkaVersion in the sarama.Config field.

In Kafka 1.40.x and older the default value if you didn't have a pinned kafka version was 1.0.0.0 protocol. In Sarama 1.41.x and newer we bumped the default to 2.1.0.0 protocol as per the Changelog https://github.com/IBM/sarama/releases/tag/v1.41.0 — this was at the request of the Kafka maintainers who are looking to remove support for older protocol versions.

That's why the problem was resolved both by rolling back client version (then rolling back to default 1.x.x.x protocol) or by rolling forward kafka version (because it then supported protocol 2.1.0.0 fine).

[puellanivis]

I’ll keep an eye out. I think we only saw it the once. Also, I’m pretty sure we updated to the new version already as well.