Skip to content

Managing log messages, configuration and big arrays in Confluent Replicator logs

Notifications You must be signed in to change notification settings

ableasdale/confluent-replicator-tools

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

43 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Confluent Replicator Tools

An application and tool to help you work through large Replicator logs, designed to run through large connect-distributed.log files in an attempt to summarise what is going on with all the messages, configuration items and arrays that Replicator maintains (and emits log messages around).

Getting Started

Start by running the main class io.confluent.csg.Server:

gradle run

Docker: download the connector logs for local inspection

In this example, the container is connect1, so we can use this command to dump the file contents out to a local file for inspection:

docker logs connect1 2> file.log

If you're debugging an issue and want to review the logs, you can use less -fr:

rm output.txt && gradle run > output.txt && less -fr output.txt

Output from after the process has run:

[2024-02-22 22:23:13,682] [INFO] Total Consumer messages: 1355
[2024-02-22 22:23:13,684] [INFO] Total Producer messages: 68
[2024-02-22 22:23:13,684] [INFO] Total WorkerTask messages: 474326
[2024-02-22 22:23:13,684] [INFO] Total WARN level messages: 57
[2024-02-22 22:23:13,684] [INFO] Total Assignment messages: 6
[2024-02-22 22:23:13,684] [INFO] Total Unclassified messages: 23343

A Web UI is also available on port 9992 by defaut:

The Web UI

About

Managing log messages, configuration and big arrays in Confluent Replicator logs

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published