Only rerun tests that failed timeouts

[plocket]

Edit: I've made this feature request in the cucumberjs lib for retrying tests as it seems there's no good way to do it at the moment. I've been told we shouldn't try to manipulate the below values.

In the cucumberjs API documentation for After(), you can pass an option to a callback called willBeRetried. I think that would let us control whether a test will be retried.

That might be a better way to:

• handle retrying tests that fail with a timeout
• avoid rerunning failed random tests.

[plocket]

Edit: I've been told we shouldn't try to manipulate these values.

This may be relevant, as willBeRetried might move. Also, though, we have to look into whether this is a property we should avoid touching.

Edit: Maybe also something in modifying test results issue at the bottom or linked in the new functionality (though I think that new functionality may actually not be capable of this).

[plocket]

Instead of avoiding rerunning random tests, we can use a seed to make random tests replicable. I'm not sure how we can then pass that value to the retry, but we can research that.