Skip to content
This repository has been archived by the owner on Oct 15, 2022. It is now read-only.

Test result is incorrect in TestRail in case of parametrized test failing for some params. Another sorting is desired #145

Open
kotus9 opened this issue Feb 13, 2021 · 1 comment

Comments

@kotus9
Copy link

kotus9 commented Feb 13, 2021

Is your feature request related to a problem? Please describe.
Test status for test in TestRail is pass, when parametrized test fails for some parameteres, but the last test param was successful.
I have found that sorting by status_id was removed due to another request where rerun-failures was used, and in that case desired sequence of test cases was different.

Describe the solution you'd like
I would love to have an ability to turn sorting by status_id on, so that if at least one param in parametrized test fails, the whole test is marked as fail in TestRail.

Describe alternatives you've considered
I've googled if it is possible to change behaviour of TestRail, but it seems, that currently TestRail decides what is the final test status based on the last test result it receives. And there is no way to change behaviour on TestRail side.

Additional context
I'll make a PR that keeps current behaviour, but adds an option to sort by status_id

@neanton
Copy link

neanton commented May 26, 2021

Any chance this PR can be merged?

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants