-
Notifications
You must be signed in to change notification settings - Fork 99
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Not able to write output into KAFKA #291
Comments
Hello @ACodingfreak, My guess is that you do not have Kafka configured with
|
@lspgn - Thanks for the reply Yes I am running kafka broker via docker-compose in node2 and goflow2 as a container in node1.
But when i execute the goflow2 inside a container from node1, I can see that topic named flows is created properly but writing messages into kafka is failing still with the DNS resolution error as shown below
|
@ACodingfreak : yes, the advertised listener is wrong, it keeps returning or try But have a look at the following https://docs.confluent.io/platform/current/kafka/multi-node.html |
Describe the bug
As shown in below logs, I am running goflow2 and kafka containers in 2 separate machines. When I try to write output into a kafka topic on the broker 10.10.26.207:9092 it just fails.
goflow2 is able to create the respective topic in the kafka instance but facing issue when writing the messages into it as it tries to resolve dns for "kafka1" which is the container name which is hosting the kafka instance.
Any specific reason why it tries to pick "kafka1" vs configured broker ?
To Reproduce
Steps to reproduce the behavior:
Run GoFlow2 with arguments '...'
./goflow2 -transport=kafka -transport.kafka.brokers=10.10.26.207:9092 -transport.kafka.topic=flows -format=text
Receive samples '....'
See error
Expected behavior
goflow2 should be able to write into respective topic created in kafka
Captures
If applicable, add output (JSON, protobuf), packet captures and device configuration.
Sampler device:
GoFlow2:
Version: [e.g. v2.0.0]
-~ $ ./goflow2 -v
GoFlow2 v2.1.2-1-gee095a9 (2024-02-27T11:23:15-0800)
Environment: [e.g. Kubernetes, Docker, Debian package]
Docker
OS: [e.g. Linux Ubuntu Server 23.04]
Ubuntu 22.04
Additional context
Add any other context about the problem here.
The text was updated successfully, but these errors were encountered: