Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

disable conda-pypi mapping for some or all channels #1342

Open
gzm55 opened this issue May 7, 2024 · 7 comments
Open

disable conda-pypi mapping for some or all channels #1342

gzm55 opened this issue May 7, 2024 · 7 comments
Labels
enhancement New feature or request

Comments

@gzm55
Copy link

gzm55 commented May 7, 2024

Problem description

can we disable the mapping feature for some channels or all channels?

@gzm55 gzm55 added the enhancement New feature or request label May 7, 2024
@tdejager
Copy link
Contributor

tdejager commented May 7, 2024

We could make a way to disable it. Could you also share the reason why you would want to disable it?

@gzm55
Copy link
Author

gzm55 commented May 7, 2024

packages from pypi and conda may be compiled with different flags, such as tensorflow, can we depends on the pypi one. Second, when enable mapping, the resolving and installing progress of the tensorflow with mapping is very very slow, in the mean while, pip install takes less then one minutes.

@tdejager
Copy link
Contributor

tdejager commented May 7, 2024

Sure, but if you add tensorflow to pypi-dependencies it should that one right? I mean you cannot have the conda package and the pypi package at the same time.

@tdejager
Copy link
Contributor

tdejager commented May 7, 2024

Would also be great if you could share your pixi.toml or pyproject.toml here :)

@gzm55
Copy link
Author

gzm55 commented May 7, 2024

Would also be great if you could share your pixi.toml or pyproject.toml here :)

[project]
name = "tf"
version = "0.1.0"
description = "Add a short description here"
channels = ["conda-forge"]
platforms = ["linux-64"]
# conda-pypi-map = { "conda-forge" = "empty.json" } # force disable mapping

[tasks]

[dependencies]
python = "3.8.*"
nomkl = ">=1.0,<2"

[system-requirements]
linux = "2.6.32" # centos 6
libc = "2.12"

[pypi-options]
index-url = "https://corp.com/pypi/simple" # a pypi mirror

[pypi-dependencies]
tensorflow = { version = ">=2.2, <2.3" }
grpcio = { version = "<1.47" }
h5py = { version = "<3.8" }

@ruben-arts
Copy link
Contributor

@gzm55 The manifest you provide should use the mapping for any packages, and should definitely not slow down the install.

I tested locally by comparing pixi install with pixi run pip install tensorflow==2.2. Funnily enough the results are exactly the same, most likely because this is simply bottle-necked by the download time.

Could it be that the fetching of the mapping is just slow for you?

@gzm55
Copy link
Author

gzm55 commented May 8, 2024

@gzm55 The manifest you provide should use the mapping for any packages, and should definitely not slow down the install.

I tested locally by comparing pixi install with pixi run pip install tensorflow==2.2. Funnily enough the results are exactly the same, most likely because this is simply bottle-necked by the download time.

Could it be that the fetching of the mapping is just slow for you?

thx, i will try later to test a pre-downloaded mapping.json.

but the conda tensorflow do not meet our needs for the compiling flags, i think a switch is still a simple solution. Or at least, when the tensorflow is not already in the conda deps set, we should keep the use request.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants