You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I want to add new labels for ALL default MetricFamily (nv_inference_request_success, nv_inference_request_failure, nv_inference_count,...) in python backend, how can I do that?
Example:
# HELP nv_inference_request_success Number of successful inference requests, all batch sizes
# TYPE nv_inference_request_success counter
nv_inference_request_success{gpu_uuid="GPU-0980dd8d-7304-ae3d-fadf-11882051f161",model="model_name",version="1", new_label="new_label_value"} 8582
# HELP nv_inference_request_failure Number of failed inference requests, all batch sizes
# TYPE nv_inference_request_failure counter
nv_inference_request_failure{gpu_uuid="GPU-0980dd8d-7304-ae3d-fadf-11882051f161",model="model_name",version="1", new_label="new_label_value"} 0
# HELP nv_inference_count Number of inferences performed (does not include cached requests)
# TYPE nv_inference_count counter
nv_inference_count{gpu_uuid="GPU-0980dd8d-7304-ae3d-fadf-11882051f161",model="model_name",version="1", new_label="new_label_value"} 8582
Thank you for your help!!
The text was updated successfully, but these errors were encountered:
I want to add new
labels
for ALL defaultMetricFamily
(nv_inference_request_success
,nv_inference_request_failure
,nv_inference_count
,...) inpython backend
, how can I do that?Example:
Thank you for your help!!
The text was updated successfully, but these errors were encountered: