Monitoring - Alertmanager, Grafana

[clickersmudge]

Hi,
We have installed monitoring as described here https://docs.kubermatic.com/kubermatic/v2.21/tutorials-howtos/monitoring-logging-alerting/master-seed/installation/.

$ kubectl get services -A
monitoring                 alertmanager                         ClusterIP      None             <none>                                             9093/TCP,6783/TCP             37m
monitoring                 alertmanager-kubermatic              ClusterIP      None             <none>                                             9093/TCP,6783/TCP             37m
monitoring                 blackbox-exporter                    ClusterIP      10.100.244.18    <none>                                             9115/TCP                      35m
monitoring                 grafana                              ClusterIP      10.103.97.129    <none>                                             3000/TCP                      35m
monitoring                 karma                                ClusterIP      10.107.45.17     <none>                                             8080/TCP                      35m
monitoring                 kube-state-metrics                   ClusterIP      None             <none>                                             8080/TCP,8081/TCP             35m
monitoring                 node-exporter                        ClusterIP      None             <none>                                             9100/TCP                      36m
monitoring                 prometheus                           ClusterIP      10.108.55.150    <none>                                             9090/TCP                      38m

$kubectl get pods -A
monitoring                 alertmanager-0                                          2/2     Running             0             41m
monitoring                 alertmanager-1                                          2/2     Running             0             41m
monitoring                 alertmanager-2                                          2/2     Running             0             40m
monitoring                 blackbox-exporter-5cb9f746d4-f5s5q                      1/1     Running             0             39m
monitoring                 grafana-765cb6cf54-44ntj                                1/1     Running             0             39m
monitoring                 karma-6cfb7f48fd-28cs6                                  1/1     Running             0             39m
monitoring                 kube-state-metrics-7c84787bd4-2hj4s                     2/2     Running             0             40m
monitoring                 node-exporter-66kbr                                     2/2     Running             0             40m
monitoring                 node-exporter-7q999                                     2/2     Running             0             40m
monitoring                 node-exporter-984fc                                     2/2     Running             0             40m
monitoring                 node-exporter-bwjh5                                     2/2     Running             0             40m
monitoring                 node-exporter-m99rw                                     2/2     Running             0             40m
monitoring                 node-exporter-znq2v                                     2/2     Running             0             40m
monitoring                 prometheus-0                                            0/3     ContainerCreating   0             42m

We added custom link to Dasboard:
https://prometheus.kubermatic.mydomain.com/
https://alertmanager.kubermatic.mydomain.com/

But not working. The website is reporting a bad certificate.

NET::ERR_CERT_AUTHORITY_INVALID
Subject: Kubernetes Ingress Controller Fake Certificate

Issuer: Kubernetes Ingress Controller Fake Certificate

[embik]

Hi @clickersmudge, I believe you might be missing Securing System Services, which is linked from the KKP installation instructions but not the page for setting up master/seed monitoring. Can you please take a look at that page and see if following it helps you setting up the external endpoints for Prometheus and Alertmanager?

[clickersmudge]

@embik Thank you.