You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
In the node-v16 CI job we have a few tests that are flaky, meaning that they sometimes pass and sometimes not. It would be nice to check which these tests are, and if possible make them deterministically passing or failing.
If there are tests that are expected to be flaky, since we cannot guarantee an external service to be up, then it makes sense to isolate these in their own CI job. That way we can distinguish more easily between an error on our side and a flaky test.
This issue should only be about identifying the flaky tests. For moving flaky tests to another CI job, we can create a follow up issue, once we are more clear on how we want to structure all of the tests.
The text was updated successfully, but these errors were encountered:
In the
node-v16
CI job we have a few tests that are flaky, meaning that they sometimes pass and sometimes not. It would be nice to check which these tests are, and if possible make them deterministically passing or failing.If there are tests that are expected to be flaky, since we cannot guarantee an external service to be up, then it makes sense to isolate these in their own CI job. That way we can distinguish more easily between an error on our side and a flaky test.
This issue should only be about identifying the flaky tests. For moving flaky tests to another CI job, we can create a follow up issue, once we are more clear on how we want to structure all of the tests.
The text was updated successfully, but these errors were encountered: