Run CI Tests on both MacOS Arm and x86

[notatallshaw]

It occured to me that pip tests currently only run on MacOS x86, which at this point could be considered problematic.

Checking the documentation (https://docs.github.com/en/actions/using-github-hosted-runners/about-github-hosted-runners/about-github-hosted-runners#standard-github-hosted-runners-for-public-repositories) it appears that you must manually specify which version of MacOS you want to get the Arm version.

This probably could be done a little more elegantly but first I wanted to see if all tests would pass on Arm.

[notatallshaw]

Well they pass, and complete faster than any of the other workers, so seems like there's little reason not to enable?

Marking ready for review.

[pradyunsg]

Hmm... macos-latest should already be running the jobs on M1, no?

[notatallshaw]

Ah, this is unexpected, they appear to have started a 12 week roll out of macos-latest to be M1 shortly after my PR: https://github.blog/changelog/2024-04-01-macos-14-sonoma-is-generally-available-and-the-latest-macos-runner-image/

I checked a recent job and pip is not yet affected by this and is still on macos-12 (https://github.com/pypa/pip/actions/runs/8601739554/job/23569705793):

Operating System
macOS
12.7.4
21H1123

It's interesting they did this because I found a lot of community feedback the new images break lots of workflows, but these seemed to mostly stem from limitations of the M1 chips so perhaps GitHub just wanted to finally bite the bullet.

I only found one issue with pip's tests on the M1 runner, SVN isn't installed by default. I will make a seperate PR for that now, but I will leave this PR open as to whether to explicitly support both x86 and ARM or whether to just support what GitHub provides as latest.

[notatallshaw]

Pip's macos-latest runner is now macos-14 causing pip CI to fail: https://github.com/pypa/pip/actions/runs/8825862850/job/24230722241

This PR supports continuing to test x86 and ARM, where as my alternative PR fixes pip CI just for ARM: #12617

[notatallshaw]

This failure is new:

FAILED tests/functional/test_install.py::test_vcs_url_urlquote_normalization - pip._internal.exceptions.InstallationSubprocessError: bzr checkout --lightweight --quiet http://bazaar.launchpad.net/%7Edjango-wikiapp/django-wikiapp/release-0.1 /private/var/folders/hv/qqnln7cj5cg0n48fcrlmbz4m0000gn/T/pytest-of-runner/pytest-1/popen-gw1/test_vcs_url_urlquote_normaliz0/cache/release-0.1 exited with 3

I guess it's a flaky test? I have no way to try to reproduce.

[notatallshaw]

I guess it's a flaky test? I have no way to try to reproduce.

Yup, I forced CI to rerun and this time the test passed.