Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update testing strategies for CI performance and robustness #154

Open
bollwyvl opened this issue Nov 4, 2023 · 0 comments
Open

Update testing strategies for CI performance and robustness #154

bollwyvl opened this issue Nov 4, 2023 · 0 comments

Comments

@bollwyvl
Copy link
Contributor

bollwyvl commented Nov 4, 2023

Elevator Pitch

Run the tests in parallel with pytest-xdist.

Motivation

In addition to being faster, pytest-xdist can find situations where file-based things (e.g. *.pyc) can create issues when run concurrently, which do occur in the wild. It works fine with pytest-cov, as well.

To make this work, the tests that use the ref and package ifxtures in test_importnb need some work to be more hygienic.

Another CI test speed thing is to skip coverage on pypy: it's a lot slower, and can cause spurious issues (especially on windows) that wouldn't impact real-world behavior where speed is the only goal.

In CI that would just be a conditional step based on python-version, potentially moving some of the configuration arguments out of the pytest options, and into the specific invocation in the hatch jobs.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant