Compare test cases to full simulation results

[mrp089]

Problem

It's a bit tedious to add new test cases because reference solutions need to be defined manually, e.g.:

svZeroDSolver/tests/test_solver.py

Lines 6 to 19 in 208c094

	def test_steady_flow_R_R():
	results = run_test_case_by_name("steadyFlow_R_R")
	assert np.isclose(
	get_result(results, "pressure_in", 0, -1), 1100.0, rtol=RTOL_PRES
	) # inlet pressure
	assert np.isclose(
	get_result(results, "pressure_out", 0, -1), 600.0, rtol=RTOL_PRES
	) # outlet pressure
	assert np.isclose(
	get_result(results, "flow_in", 0, -1), 5.0, rtol=RTOL_FLOW
	) # inlet flow
	assert np.isclose(
	get_result(results, "flow_out", 0, -1), 5.0, rtol=RTOL_FLOW
	) # outlet flow

Solution

Store a reference solution (computed with svZeroDSolver) with git lfs in a folder for each test case and automatically compare all flow and pressure results. This makes it easier to add new tests and also tests stricter since the whole solution is compared to a reference. We already do this in svFSI+.

Additional context

We still retain information from analytically computed reference solutions as these are stored in the test cases themselves.

Code of Conduct

• I agree to follow this project's Code of Conduct and Contributing Guidelines