Question/Bug: runing state and order dependent tests with ctest

[stefaneicher]

Hi,

If I understand it correctly, you test in OrderedTestTest.cpp

cpputest/tests/CppUTestExt/OrderedTestTest.cpp

Line 225 in 484e098

TEST_ORDERED(TestOrderedTestMacros, Test10, 10)

as sequence. The tests share a state and depend on this shared state and its order.

Now you run them with ctest. The problem is the ctest runs each test in a new process. Meaning the test fail.

We (@balazs-dot and @stefaneicher ) tested in version 4.0 with setting (TESTS_DETAILED on V4.0, CPPUTEST_TESTS_DETAILED in latest)

cpputest/cmake/Modules/CppUTest.cmake

Line 6 in 484e098

option(CPPUTEST_JUNIT_REPORT "Output JUnit test reports")

cpputest/tests/CppUTestExt/CMakeLists.txt

Line 41 in 67d2dfd

if (TESTS_BUILD_DISCOVER)

Solution:
replacing
cpputest_buildtime_discover_tests(CppUTestExtTests)
with
add_test(NAME CppUTestExtTests COMMAND CppUTestExtTests)
caused the desired behavior of running all test in one process

[thetic]

https://github.com/cpputest/cpputest/blob/484e09883a5b996026a25e85a89ada7e5b23ac95/tests/CppUTestExt/CMakeLists.txt#L49C1-L51