BLD, CI: Use cibuildwheel to build Emscripten/Pyodide wheels, push nightlies to Anaconda.org

[agriyakhetarpal]

• This is a follow-up PR to BLD, TST: Build and test Pyodide wheels for pandas in CI #57896 as stated in ENH: out-of-tree Pyodide builds in CI for pandas #57891
• Tests added and passed if fixing a bug or adding a new feature
• All code checks passed.
• Added type annotations to new arguments/methods/functions.
• Added an entry in the latest doc/source/whatsnew/vX.X.X.rst file if fixing a bug or adding a new feature.

Description

This PR duplicates the Pyodide wheel builder job that was set up in #57896 into wheels.yml, except that in this case the wheel is not tested and the wheel builder uses cibuildwheel enabled with Pyodide to build the wheels. Subsequently, the upload_wheels.sh script will be used with the appropriate repository secret to upload the Pyodide wheel to https://anaconda.org/scientific-python-nightly-wheels/pandas.

Additional context

1. This is how this was done for NumPy: CI, BLD: Push NumPy's Emscripten/Pyodide wheels nightly to Anaconda.org PyPI index numpy/numpy#26134
2. At a later time, these wheels will be used to configure interactive documentation via JupyterLite through jupyterlite-sphinx that acts upon doctest-based examples. The blocker in that regard is setting up a method to pre-install these wheels to provide them to the jupyterlite-pyodide-kernel and make them available at run time, and progress is being made in this area.

Adding an xref for tracking purposes, the action from main will be used until a stable release of cibuildwheel is available that can build Pyodide wheels: pypa/cibuildwheel#1456

[agriyakhetarpal]

This condition can probably be skipped, because the intention of this PR is not to upload to https://anaconda.org/multibuild-wheels-staging/pandas,

[agriyakhetarpal]

I have included this step in case it is needed to inspect the binary and do some debugging – happy to remove it based on what is suggested.

[lithomas1]

Looks like cibuildwheel might be adding pyodide here
pypa/cibuildwheel#1456

Maybe we should wait for that PR?

[agriyakhetarpal]

Hi @lithomas1, I would advise holding off on that PR – it's stalled for many reasons, for example the fact that Pyodide does releases bi-annually with updated Python versions and Emscripten versions which will break the ABI – i.e., while the specification for breaking changes and ABI stability for the platform might exist, it has not been formalised through the means of a PEP yet; and because PyPI has not yet received support through a PEP for formalising the wasm32 tag through packaging and pip, which means that micropip remains the only choice for installing these wheels (which, then, does not come with resolvelib, AFAIK) and wheels need to be pushed to alternative indices – Anaconda.org, in this case. However, out-of-tree build support in the ecosystem is improving day by day; it could be a viable candidate sometime soon. In the meantime, this current method of building should be a reasonable alternative since it's tightly integrated into and similar to Pyodide's in-tree builds with the pyodide build CLI.

[agriyakhetarpal]

I ended up asking around on that PR and it has been merged now after more than a year of effort; cibuildwheel hasn't had a release with it yet, but following these recent developments I have tried it for NumPy and it works nicely: numpy/numpy#26570 – let me replace the configuration here as well and rebase this branch.

I would still recommend using this existing configuration because it's much more stable and it will allow us to get these wheels uploaded to Anaconda.org much quicker, but in any case, that's not a high-priority pressing issue right now, so I would not mind if there is a delay with that and I understand that the review process can take time, running on its own accord.

[agriyakhetarpal]

Both the wheel build and the tests pass 🎉: https://github.com/pandas-dev/pandas/actions/runs/9307939926/job/25620279093

I'll convert this to a draft for now – I will mark it as ready for review as soon as a stable cibuildwheel release hits.