Time is limited.
It is not realistic to create a test case that satisfies all the multiple factors, and above all, it is tedious.
Save time with covertable. It is a flexible pairwise tool to create a two (or more) factor covered combination.
Now it has 2 implementations.
- Python
- TypeScript
Go see the detail from these links.
Note
- The following data was measured in Python 3.7.7 and
3.1 GHz 6 Cores Intel Core i5
. - coverage number is 2.
Combination | Default | Minimum case | Fastest case |
---|---|---|---|
3^4 |
|
|
|
3^13 |
|
|
|
4^15 + 3^17 + 2^29 |
|
|
|
4^1 + 3^39 + 2^35 |
|
|
|
2^100 |
|
|
|
10^20 |
|
|
|
In general, as the number of elements or coverage increases, the number of combinations have a tendency to increase significantly.
If you use greedy criterion and specify a positive integer to tolerance option, it can increase the speed at the expense of the number of combinations.
The greater the tolerance, the shorter the speed and bigger the number of combinations.
Table for the case when combinations are created from10^20
test cases.
tolerance | num | time |
---|---|---|
0 (default) | 195 |
14.48s |
1 | 199 |
12.45s |
2 | 201 |
9.48s |
3 | 201 |
7.17s |
4 | 207 |
5.70s |
5 | 212 |
4.58s |
6 | 212 |
3.65s |
7 | 216 |
3.07s |
8 | 223 |
2.57s |
9 | 226 |
2.14s |
10 | 233 |
1.84s |
11 | 237 |
1.61s |
12 | 243 |
1.43s |
13 | 249 |
1.28s |
14 | 254 |
1.19s |
- 2.0.x
- sorter option was splitted into sorter and criterion.
- e.g. greedy -> hash sorter + greedy criterion.
- greedy method is much faster than before.
- greedy method got an option tolerance to balance speed and results.
- sequenctial sorter was dropped.
- Because The number of combinations would be huge in TypeScript.
- 1.1.x
- Greedy sorter improved in both implementations.
- It got increased in speed.
- 1.0.x
- First release 🎉