Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Whitebox Grafana dashboard #85

Open
momegas opened this issue Jan 3, 2023 · 0 comments
Open

Whitebox Grafana dashboard #85

momegas opened this issue Jan 3, 2023 · 0 comments
Assignees
Labels
enhancement New feature or request good first issue Good for newcomers help wanted Extra attention is needed

Comments

@momegas
Copy link
Member

momegas commented Jan 3, 2023

As whitebox produces metrics, we need a way to display them in a dashboard.

Grafana is a nice and flexible dashboard tool made exactly for this kind of purposes.

The dashboard should display key metrics and statistics related to the performance of machine learning models. This will help users to track the performance of models over time, identify areas for improvement, and ensure that models are serving customers effectively.

Some ideas for what to include in the dashboard:

  • Model accuracy over time
  • Model training and evaluation times
  • Model resource usage (e.g. GPU memory and compute time)
  • Number of model predictions made

In short, we need a dashboard that displays all Whitebox metrics depending on model type.

Note: Since dashboards in Grafana cannot be dynamic (you only import a JSON) we may need an endpoint that produces the said JSON so that the user can copy it and import it in Grafana. This should also be doable from the SDK as well.

@momegas momegas added the needs analysis This issue needs analysis label Jan 3, 2023
@momegas momegas added this to the Whitebox Roadmap milestone Jan 3, 2023
@momegas momegas added enhancement New feature or request and removed needs analysis This issue needs analysis labels Jan 3, 2023
@momegas momegas changed the title Whitebox Grafana dashboard [Roadmap] Whitebox Grafana dashboard Jan 4, 2023
@momegas momegas added help wanted Extra attention is needed good first issue Good for newcomers component/api labels Jan 4, 2023
@momegas momegas modified the milestones: 🐻‍❄️ Whitebox Roadmap, Q1 2023 Jan 18, 2023
@momegas momegas modified the milestones: 🐶 Q1 2023, 😻 Q2 2023 Feb 7, 2023
@momegas momegas changed the title [Roadmap] Whitebox Grafana dashboard Whitebox Grafana dashboard Feb 15, 2023
@NickNtamp NickNtamp self-assigned this Mar 10, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request good first issue Good for newcomers help wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests

2 participants