Automated UI Tests
This wiki page describes the state of test automation in Focus for iOS.
The CI tool used is Bitrise. In main branch, every check in is verified with unit test suite and SmokeTest suite upon merge. It is also enabled by default on Bitrise when a build is triggered via a PR request.
A build implies building and running tests for Focus and Klar apps. It is managed thanks to a build that once triggered, starts a build for each product. Those two builds run in parallel.
There are two main schemes, one for each product.
- Focus
- Klar
In addition to these, there are also another two containing the L10nScreenshots tests. These schemes are only to run specific tests used to get the screenshots to be shared with the localization team
The test plans use the Klar and Focus shemes to run the corresponding tests.
- Smoketest: There are 8 tests enabled. This test suite is aligned with the manual one defined in TestRail.
- Full Functional Test Suite: Containing 31 tests.
The way how/when the tests run for each scheme is defined in the table below:
| Branch | SmokeTest | Full Functional Tests |
|---|---|---|
| iPhone / iPad | iPhone / iPad | |
| main | PR, Push / Sched.(3/w) | Sched.(2w) / - |
| refresh | PR, Push / - | - / - |
WIP to enable tests on those ares where there are not any running yet
The UI/XCUI Test automation status is being updated here: https://github.com/mozilla-mobile/focus-ios/projects/6. You are welcome to take one from our to-do lists and make contributions.
Please send questions to irios@mozilla.com or ping :irios in mozilla slack.