Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Comparative benchmarks [Feature] #56

Open
sfmig opened this issue Dec 14, 2023 · 0 comments
Open

Comparative benchmarks [Feature] #56

sfmig opened this issue Dec 14, 2023 · 0 comments
Assignees
Labels
enhancement New feature or request

Comments

@sfmig
Copy link
Contributor

sfmig commented Dec 14, 2023

We consider two types of benchmarks:

  • We run absolute benchmarks on our internal runner, using user-representative datasets. These benchmarks will run regularly and the results will be published to a static site.

  • We run relative benchmarks on CI with small data. This is useful to detect if a PR introduces performance regressions. We plan to follow an approach similar to the one proposed here.

We first plan to implement the first type, but it would be very useful to have a go at the second one too.

@sfmig sfmig added the enhancement New feature or request label Dec 14, 2023
@sfmig sfmig self-assigned this Dec 14, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant