Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Python Backend: How can i add a new labels for all default MetricFamily? #7098

Open
nhhviet98 opened this issue Apr 11, 2024 · 1 comment
Open
Labels
module: server Issues related to the server core and frontends

Comments

@nhhviet98
Copy link

nhhviet98 commented Apr 11, 2024

I want to add new labels for ALL default MetricFamily (nv_inference_request_success, nv_inference_request_failure, nv_inference_count,...) in python backend, how can I do that?

Example:

# HELP nv_inference_request_success Number of successful inference requests, all batch sizes
# TYPE nv_inference_request_success counter
nv_inference_request_success{gpu_uuid="GPU-0980dd8d-7304-ae3d-fadf-11882051f161",model="model_name",version="1", new_label="new_label_value"} 8582

# HELP nv_inference_request_failure Number of failed inference requests, all batch sizes
# TYPE nv_inference_request_failure counter
nv_inference_request_failure{gpu_uuid="GPU-0980dd8d-7304-ae3d-fadf-11882051f161",model="model_name",version="1", new_label="new_label_value"} 0

# HELP nv_inference_count Number of inferences performed (does not include cached requests)
# TYPE nv_inference_count counter
nv_inference_count{gpu_uuid="GPU-0980dd8d-7304-ae3d-fadf-11882051f161",model="model_name",version="1", new_label="new_label_value"} 8582

Thank you for your help!!

@Tabrizian
Copy link
Member

Tabrizian commented Apr 19, 2024

I think It is not possible right now. @rmccorm4 do you think this is something we could add?

@Tabrizian Tabrizian added the module: server Issues related to the server core and frontends label Apr 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
module: server Issues related to the server core and frontends
Development

No branches or pull requests

2 participants