Spike: Aggregate device failures into a new section called 'All results' which shows all tests across all devices #116
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Note - this is a spike PR, so placing it here to get some feedback. The code provided solves the problem but is not necessarily well architected
At my company we have started distributing UI tests to run them in parallel and get faster feedback. We coagulate results using
XCTestHTMLReportand they come back as a per device report. The command to generate the report will take test results from each run isxchtmlreport -r TestResults-0 -r TestResults-1 ...where the directory for the test run was copied off of a node that performed the run.The generated report can have many separate devices that need selecting to be able to see failures, this is time consuming. The PR adds a new section which will show all tests on all devices to alleviate the single device selection. See screenshot. The main difficulty with this implementation was keeping the
UUIDunique in the generated HTML, the current solution to that is to prefix eachUUIDwithALLand so the javascript and HTML still work.