Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Sort regression tests by ascending time #585

Open
bhourahine opened this issue Jul 29, 2020 · 1 comment
Open

Sort regression tests by ascending time #585

bhourahine opened this issue Jul 29, 2020 · 1 comment

Comments

@bhourahine
Copy link
Member

Also, look for shorter tests for some of the slower ones.

@awvwgk
Copy link
Member

awvwgk commented Jul 29, 2020

An easy solution would be to add a cost descriptor to existing test, it could be easily generated in somewhat machine agnostic way by running the testsuite once sequentially and normalizing the cost roughly by the fastest test (with a lower limit where the test is considered instant). Generally, marking some more basic tests and splitting the testing in a multiple stages to avoid running expensive test when the basics fail would probably be more helpful (maybe similar like we are using the LONG_TEST marker now).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants