Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Kibana still spamming logs when different version from Elasticsearch #14480

Closed
ctindel opened this issue Oct 18, 2017 · 3 comments
Closed

Kibana still spamming logs when different version from Elasticsearch #14480

ctindel opened this issue Oct 18, 2017 · 3 comments
Labels
Team:Operations Team label for Operations Team

Comments

@ctindel
Copy link

ctindel commented Oct 18, 2017

I thought maybe it was resolved by this PR:

#8865

But I am still seeing this message printed every few seconds (Kibana 5.4.3 talking to ES 5.6.3). it isn't possible to upgrade since the kibana plugin I'm using is only written against 5.4.3.

{"type":"log","@timestamp":"2017-10-18T04:52:25Z","tags":["warning"],"pid":1,"kibanaVersion":"5.4.3","nodes":[{"version":"5.6.3","http":{"publish_address":"10.43.188.45:18923"},"ip":"10.43.188.45"},{"version":"5.6.3","http":{"publish_address":"172.25.69.187:18281"},"ip":"172.25.69.187"},{"version":"5.6.3","http":{"publish_address":"10.232.131.86:18308"},"ip":"10.232.131.86"}],"message":"You're running Kibana 5.4.3 with some different versions of Elasticsearch. Update Kibana or Elasticsearch to the same version to prevent compatibility issues: v5.6.3 @ 10.43.188.45:18923 (10.43.188.45), v5.6.3 @ 172.25.69.187:18281 (172.25.69.187), v5.6.3 @ 10.232.131.86:18308 (10.232.131.86)"}

{"type":"log","@timestamp":"2017-10-18T04:52:27Z","tags":["warning"],"pid":1,"kibanaVersion":"5.4.3","nodes":[{"version":"5.6.3","http":{"publish_address":"172.25.69.187:18281"},"ip":"172.25.69.187"},{"version":"5.6.3","http":{"publish_address":"10.43.188.45:18923"},"ip":"10.43.188.45"},{"version":"5.6.3","http":{"publish_address":"10.232.131.86:18308"},"ip":"10.232.131.86"}],"message":"You're running Kibana 5.4.3 with some different versions of Elasticsearch. Update Kibana or Elasticsearch to the same version to prevent compatibility issues: v5.6.3 @ 172.25.69.187:18281 (172.25.69.187), v5.6.3 @ 10.43.188.45:18923 (10.43.188.45), v5.6.3 @ 10.232.131.86:18308 (10.232.131.86)"}

{"type":"log","@timestamp":"2017-10-18T04:52:32Z","tags":["warning"],"pid":1,"kibanaVersion":"5.4.3","nodes":[{"version":"5.6.3","http":{"publish_address":"10.43.188.45:18923"},"ip":"10.43.188.45"},{"version":"5.6.3","http":{"publish_address":"172.25.69.187:18281"},"ip":"172.25.69.187"},{"version":"5.6.3","http":{"publish_address":"10.232.131.86:18308"},"ip":"10.232.131.86"}],"message":"You're running Kibana 5.4.3 with some different versions of Elasticsearch. Update Kibana or Elasticsearch to the same version to prevent compatibility issues: v5.6.3 @ 10.43.188.45:18923 (10.43.188.45), v5.6.3 @ 172.25.69.187:18281 (172.25.69.187), v5.6.3 @ 10.232.131.86:18308 (10.232.131.86)"}

@jbudz jbudz added the Team:Operations Team label for Operations Team label Oct 30, 2017
@ppf2
Copy link
Member

ppf2 commented Nov 21, 2018

+1 Still an issue in later 6.4.3 version:

Apart from this being a spamming issue (for example, I am sampling 10K lines from a multiple Gb Kibana log file where 9800+ lines are these compatibility messages), the message is also contradictory to our support matrix where we indicate that patch versions of Kibana <-> ES are compatible (e.g., Kibana 6.4.x is compatible with ES 6.4.x).

{"type":"log","@timestamp":"2018-11-21T10:10:30Z","tags":["warning"],"pid":2613,"kibanaVersion":"6.4.3","nodes":[{"version":"6.4.0","http":{"publish_address":"IP:9200"},"ip":"IP"}],"message":"You're running Kibana 6.4.3 with some different versions of Elasticsearch. Update Kibana or Elasticsearch to the same version to prevent compatibility issues: v6.4.0 @ IP:9200 (IP)"}

@rudolf
Copy link
Contributor

rudolf commented Jan 8, 2020

I can confirm this bug. It seems like #8865 assumes a stable ordering of nodes from the ES nodes API when determining if a log message had been seen before. When Elasticsearch returns a different node ordering from the _nodes API we end up logging up to N duplicate messages (where N is the amount of ES nodes).

@rudolf
Copy link
Contributor

rudolf commented Feb 5, 2020

Closed by #51311

@rudolf rudolf closed this as completed Feb 5, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Team:Operations Team label for Operations Team
Projects
None yet
Development

No branches or pull requests

5 participants