Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

FreeBSD failure to trigger 'STM Sys test parallel' #410

Open
jmid opened this issue Nov 10, 2023 · 0 comments
Open

FreeBSD failure to trigger 'STM Sys test parallel' #410

jmid opened this issue Nov 10, 2023 · 0 comments
Labels
test suite reliability Issue concerns tests that should behave more predictably

Comments

@jmid
Copy link
Collaborator

jmid commented Nov 10, 2023

In #409 a FreeBSD CI run on 5.0.0 failed to trigger a counterexample in STM Sys test parallel within 1000 attempts:
https://ocaml-multicoretests.ci.dev:8100/job/2023-11-09/084832-ci-ocluster-build-542efa

random seed: 4002063
generated error fail pass / total     time test name

[ ]    0    0    0    0 / 1000     0.0s STM Sys test sequential
[ ]    0    0    0    0 / 1000     0.0s STM Sys test sequential (generating)
[✓] 1000    0    0 1000 / 1000     4.8s STM Sys test sequential

[ ]    0    0    0    0 / 1000     0.0s STM Sys test parallel
[ ]  512    0    0  512 / 1000    55.3s STM Sys test parallel
[✗] 1000    0    0 1000 / 1000   115.0s STM Sys test parallel

--- Failure --------------------------------------------------------------------

Test STM Sys test parallel failed:

Negative test STM Sys test parallel succeeded but was expected to fail
================================================================================
failure (1 tests failed, 0 tests errored, ran 2 tests)
File "src/sys/dune", line 4, characters 7-16:
4 |  (name stm_tests)
           ^^^^^^^^^
(cd _build/default/src/sys && ./stm_tests.exe --verbose)
Command exited with code 1.
@jmid jmid mentioned this issue Nov 10, 2023
@jmid jmid added the test suite reliability Issue concerns tests that should behave more predictably label Nov 10, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
test suite reliability Issue concerns tests that should behave more predictably
Projects
None yet
Development

No branches or pull requests

1 participant