bundlelogger

An extension for python's logging module that bundles frequently recurring but equal log messages

Example Output

14,746 INFO: 1234 errors following, long pause after #204
14,747 ERROR: fail
14,762 ERROR: fail
14,775 ERROR: fail
14,789 ERROR: fail
14,803 ERROR: fail
14,875 ERROR: [10 repetitions] fail
15,076 ERROR: [20 repetitions] fail
15,505 ERROR: [50 repetitions] fail
16,280 ERROR: [100 repetitions] fail
17,723 ERROR: [200 repetitions] fail
17,813 ERROR: [204 repetitions] fail
37,073 ERROR: [500 repetitions] fail
44,127 ERROR: [1000 repetitions] fail
47,466 ERROR: [1234 repetitions] fail
47,480 INFO: Test completed

Usage

import logging
from bundlelogger import BundleLogger

logging.Logger.manager.setLoggerClass(BundleLogger)

Customisation

LOG = logging.getLogger("mylog")
LOG.setLevel(logging.DEBUG)

# Specify the longest time in seconds to withhold a message and wait for the next repetition
LOG.setMaxDelay(10*60)

# Specify the minimum number of consecutive messages that are considered repetitions
LOG.setMinRepetitions(5)

A demo can be found at the bottom of bundlelogger.py

License

Copyright 2017 Philipp Niedermayer (github.com/eltos)

Licensed under the Apache License 2.0

You may only use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software in compliance with the License. For more information visit http://www.apache.org/licenses/LICENSE-2.0
The above copyright notice alongside a copy of the Apache License shall be included in all copies or substantial portions of the Software.