Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

inconsistent test count reported in Jenkins if tests are flaky #335

Open
dirk-thomas opened this issue Sep 15, 2016 · 0 comments
Open

inconsistent test count reported in Jenkins if tests are flaky #335

dirk-thomas opened this issue Sep 15, 2016 · 0 comments
Labels
duplicate This issue or pull request already exists

Comments

@dirk-thomas
Copy link
Member

The nightly jobs reruns failed test with ctest --rerun-failed. But since this run overwrites the generated Test.xml Jenkins will report a different number of test because tests which passed in the initial run are not included in the new result file anymore. I don't think there is much we can do (except parsing the result file before and after and implementing our own merge strategy). I have reported the problem upstream, maybe it gets addressed in CTest directly: https://gitlab.kitware.com/cmake/cmake/issues/16314

@dirk-thomas dirk-thomas transferred this issue from ros2/ros2 Sep 5, 2019
@dirk-thomas dirk-thomas added the duplicate This issue or pull request already exists label Sep 10, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
duplicate This issue or pull request already exists
Projects
None yet
Development

No branches or pull requests

1 participant