Ability to remove fields/groups of fields for the Kubernetes labels and annotations

[silverm0on]

I would like the ability to remove some annotations and labels in the kubernetes fields.
I use record_modifier but it's not working for kubernetes fields

[liquidsaul]

Bump on this, did you find a solution @silverm0on ?

[silverm0on]

@liquidsaul Nope just disable all kubernetes labels in logging resource

filterKubernetes:
  Labels: "Off"

[duhow]

I'm also interested on this. I've tested using remove_keys in both Flow and Output without success.

I want to remove unneeded Kubernetes labels to avoid sending to Loki.

[SSvilen]

@duhow

you can do something like this in the output and pick only the labels you want:

    configure_kubernetes_labels: false
    labels:
      namespace: "$.kubernetes.namespace_name"
      pod: "$.kubernetes.pod_name"
      container: "$.kubernetes.container_name"
      host: "$.kubernetes.host"

[duhow]

Thanks @SSvilen ! Does this also support Pods that may not include those labels? (thinking of different applications).

[SSvilen]

Those labels come from fluentbit and they are always present.
You can see here, which are the 6 default labels, which are always present.
You can add any label (as long as it's present) using:

$.kubernetes.labels.%label_name%

the documentation for the loki fluentd output can be found here

[stale[bot]]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions!

[pepov]

I haven't yet tried, but anyone has an idea, why this cannot be achieved with record_modifier or record_transformer?

[pepov]

Converted this to a discussion until we have a better understanding what is happening here