Grafana dashboard for milvus with multi-tenancy strategies

[kish5430]

HI Team,

We have implemented multi-tenancy strategies in milvus, but we can currently view overall cluster resource utilization, we're unable to see the database level utilization. Could you please add a feature that allows us to see database-level stats or a Grafana dashboard? This would enable us to analyze resource usage at the database level.

Thanks

[xiaofan-luan]

feel free to open a github issue for that. This could be a potential feature to improve

[kish5430]

I mean there is no issue , we need this feature to see the resource utilisation at database level.

[xiaofan-luan]

Sure I understand. We just create track features in github issue as well~

[xiaofan-luan]

BTW, I'd like to learn about your use case and feature requirment if you'd like to share.
My email is james.luan@zilliz.com and we definitely want to hep

[kish5430]

We want to implement Multi-tenancy strategies within Milvus. Additionally, it's important for us to track resource utilization individually

[xiaofan-luan]

Sure, we should be working on collection level metrics and db level metrics.

@LoveEachDay

[kish5430]

Also can you plz add collection and database name for metric "milvus_proxy_req_count".

[xiaofan-luan]

I'm not sure how we can display collection level metrics on graphana. Anyone could help on this would be great

[xiaofan-luan]

We need collections,
collection insert, delete, query, search, upsert QPS/latency and entity numbers

[LoveEachDay]

@kish5430 Milvus 2.4 has added database level metrics. And we'll refine the grafana dashboard in the next coming week.

[kish5430]

HI @LoveEachDay Could you please provide ETA for releasing the refined Grafana dashboard?

[LoveEachDay]

@kish5430 Only for selected metrics with database name label. We are adding more metrics with database name label. We will release the new dashboard alongside milvus 2.4.1 release.

[kish5430]

@LoveEachDay It appears that the Milvus 2.4.1 version now includes a database label in the metrics for delete and bulk insert operations. Could you please also include collection creation,load, search and query operations?

• Added db label to the metrics for the delete and bulk insert operations(enhance: add db label for deletion and bulkinsert operation #32611)

[kish5430]

HI @LoveEachDay Could you provide an update on adding metrics for collection creation, loading, searching, and querying operations?

[yhmo]

The work is still in progress, stay tuned.