Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ImportError: Apex was not found. Please see the NeMo README for installation instructions: https://github.com/NVIDIA/NeMo#megatron-gpt. #101

Open
pradeepdev-1995 opened this issue Apr 8, 2024 · 3 comments
Assignees
Labels
bug Something isn't working

Comments

@pradeepdev-1995
Copy link

pradeepdev-1995 commented Apr 8, 2024

I am trying the below Lora training notebook
https://github.com/NVIDIA/GenerativeAIExamples/blob/main/models/Gemma/lora.ipynb
When running the below code segment

from nemo.collections.nlp.parts.megatron_trainer_builder import MegatronLMPPTrainerBuilder
from nemo.utils.exp_manager import exp_manager

trainer = MegatronLMPPTrainerBuilder(cfg).create_trainer()
exp_manager(trainer, cfg.exp_manager)

I am getting the error

ImportError: Apex was not found. Please see the NeMo README for installation instructions: https://github.com/NVIDIA/NeMo#megatron-gpt.

So as per the official documentation when I try to install Apex,

git clone https://github.com/NVIDIA/apex.git
cd apex
git checkout b496d85fb88a801d8e680872a12822de310951fd
pip install -v --no-build-isolation --disable-pip-version-check --no-cache-dir --config-settings "--build-option=--cpp_ext --cuda_ext --fast_layer_norm --distributed_adam --deprecated_fused_adam" ./

this installation raises the given error


Usage:
  pip install [options] <requirement specifier> [package-index-options] ...
  pip install [options] -r <requirements file> [package-index-options] ...
  pip install [options] [-e] <vcs project url> ...
  pip install [options] [-e] <local project path> ...
  pip install [options] <archive url/path> ...
no such option: --config-settings

Screenshot from 2024-04-04 10-51-03

@shubhadeepd shubhadeepd self-assigned this Apr 22, 2024
@shubhadeepd
Copy link
Collaborator

shubhadeepd commented Apr 22, 2024

Thanks for reporting this.
We are checking this and will get back to you shortly.
@nealvaidya please help check this issue.

@shubhadeepd shubhadeepd added the bug Something isn't working label Apr 22, 2024
@shashank3959
Copy link
Contributor

@pradeepdev-1995 did you try using the NeMo container which should have the dependencies installed?
image

@pradeepdev-1995
Copy link
Author

@shashank3959
Yes i am using this container

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

3 participants