Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fast-fail mode? #206

Open
exodist opened this issue Dec 3, 2020 · 3 comments
Open

fast-fail mode? #206

exodist opened this issue Dec 3, 2020 · 3 comments

Comments

@exodist
Copy link
Member

exodist commented Dec 3, 2020

Might make sense to add a fast-fail mode, where the moment anything happens that makes the test fail, it is killed and reported as failure, not allowed to continue.

Why:

Often at work I find myself running the entire test suite just to get a list of what tests fail. Usually this is because of a new feature or big change. I mainly just want a count of failures, and will then run the tests one by 1 to figure out the issue and fix it. In this case having a failing test continue to stumble does not help, I do not need the extra debugging. In this case a fast-fail would save me a lot of time.

Maybe --fast-fail?

This should probably wait for the 'overlord' branch to be completed and merged, the implementation would be significantly simpler.

@toddr
Copy link
Collaborator

toddr commented Dec 3, 2020

doesn't test::more already provide that? https://metacpan.org/pod/Test::More#BAIL_OUT

@exodist
Copy link
Member Author

exodist commented Dec 3, 2020

If you add that to every test yes, but then it is always on. I am talking a global switch for it. I guess you could just pass yath the option to import DieOnFail for every test, BailOnFail is not what we want here cause a bail kills the whole suite, I just want to kill the test that is already known to be failing.

@exodist
Copy link
Member Author

exodist commented Dec 3, 2020

Also DieOnFail is not sufficient, need an ExitOnFail as a lot of failures can happen in eval's.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants