Assistance Needed with Prometheus and Alertmanager Configuration #13860
Unanswered
Trio-official
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I am encountering challenges with configuring Prometheus and Alertmanager for my application's alarm system. Below are the configurations I am currently using:
prometheus.yml:
Scrape Interval: 1h
rules.yml:
alertmanager.yml:
Issues:
Inconsistent Alerting: The similarity in scrape interval and recording rule evaluation interval (both set to 1 hour) leads to instances where Prometheus scrapes data before the recording rule evaluation. Consequently, during the recording rule evaluation, there may be no value in the metric, resulting in the recording rule failing to trigger an alert despite the condition being satisfied.
Discrepancy in Firing Alerts: The number of firing alerts in Prometheus varies significantly from the number of alerts received by Alertmanager, causing inconsistency and confusion in alert handling.
Uncertainty in Alert Evaluation Timing: The alerting rule seems to be evaluated inconsistently, sometimes triggering alerts shortly after service restart, while other times with delays beyond the expected 4-hour interval.
Request for Assistance:
I am seeking guidance on configuring Prometheus and Alertmanager to achieve the following:
Thanks in advance.
Beta Was this translation helpful? Give feedback.
All reactions