Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Metrics collection - Error rate #60

Open
2 tasks
litalmason opened this issue Dec 24, 2023 · 0 comments
Open
2 tasks

Metrics collection - Error rate #60

litalmason opened this issue Dec 24, 2023 · 0 comments
Assignees
@nganani
Labels
feature New feature
Milestone
1.2.0

Comments

@litalmason
Copy link
Collaborator

litalmason commented Dec 24, 2023 •
edited by nganani

Description

Implement "error rate" metric. Each experiment must log the number of runs that failed.

Acceptance Criteria

  1. Log number of runs that failed for each test run (every experiment, or test suite, contains one or more test runs. each test run include a combination of algorithm, number of iterations and message size)
  2. Calculate the error rate from the number of failed run out of the total number of iterations for a specific test run

Tasks

Be the first to suggest how to break this feature into individual tasks

  • Task 1
  • Task 2
@litalmason litalmason added the feature New feature label Dec 24, 2023
@litalmason litalmason added this to the 1.2.0 milestone Dec 24, 2023
@nganani nganani self-assigned this Jan 3, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@nganani nganani

Labels
feature New feature
Projects
Qujata
Status: No status
Milestone
1.2.0
Development

No branches or pull requests
2 participants
@nganani @litalmason