dashboard: kibana dashboard with support for > 8.0

[v1v]

What

Support Kibana version > 8.0 in addition to 7.17.

Changes

• Use index pattern "traces-apm*,apm-*,logs-apm*,apm-*,metrics-apm*,apm-*"
• Remove hardcoded graph for Agent Allocation Duration
• Average Job Durations uses transaction.duration.us

Issue

Closes #378

[cyrille-leclerc]

Thanks for working on a fix.

I was wondering why we had this attribute ci.pipeline.run.durationMillis which overlaps a lot with the transaction duration (transaction being the root span of the job).

Could we replace our usage of ci.pipeline.run.durationMillis by the transaction.duration.us of the pipeline root spans (e.g. spans matching labels.ci_pipeline_run_result:*). It would mostly needs a conversion from microseconds (us to millis).

With this, could we have a dashboard compatible with 7.x and 8.x?

[v1v]

With this, could we have a dashboard compatible with 7.x and 8.x?

I just updated the new dashboard that's compatible with both versions, thanks for the tip about using the transaction time.

It would mostly needs a conversion from microseconds (us to millis).

IIUC, Kibana does not support aggregations with bucket script -> elastic/kibana#4707

Therefore, it will require to use Kibana Lens to allow this transformation, for now, I didn't make that change but in a follow up to use Kibana Lens for all the graphs instead the traditional Kibana graphs