Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[QST]: cufile.log Path Change #514

Open
FabianHoerst opened this issue Feb 14, 2023 · 4 comments
Open

[QST]: cufile.log Path Change #514

FabianHoerst opened this issue Feb 14, 2023 · 4 comments
Labels
question Further information is requested

Comments

@FabianHoerst
Copy link

What is your question?
Hello, is there a way to change the cufile.log path? It is always created in the entrypoint folder of my python module.

Thanks in advance!

@FabianHoerst FabianHoerst added the question Further information is requested label Feb 14, 2023
@FabianHoerst FabianHoerst changed the title [QST]: cufile.log [QST]: cufile.log Path Change Feb 14, 2023
@jakirkham
Copy link
Member

Maybe this doc is helpful?

@mingxin-zheng
Copy link

mingxin-zheng commented Feb 19, 2023

I also noticed this happens with the nvidia pytorch 22.11 container and versions after.
To reproduce it

docker run -it --rm --gpus all nvcr.io/nvidia/pytorch:22.09-py3 bash -c "pip install cucim; python -c 'import cucim'; ls 'cufile.log'"

In 22.10 and earlier:

docker run -it --rm --gpus all nvcr.io/nvidia/pytorch:22.10-py3 bash -c "pip install cucim; python -c 'import cucim'; ls 'cufile.log'"

It will throw the error: ls: cannot access 'cufile.log': No such file or directory

In the cufile.log:

 19-02-2023 06:10:38:318 [pid=97 tid=97] NOTICE  cufio-drv:705 running in compatible mode

I am looking for the correct practices. (1) Is this log notice something that needs fix? (2) If I need to move the log file to other places, is there some convention where this file should belong to?

Thank you

@gigony
Copy link
Contributor

gigony commented Mar 1, 2023

In the https://docs.nvidia.com/gpudirect-storage/troubleshooting-guide/index.html#enable-diff-log-file-app

If the logging:dir property in the default /etc/cufile.json file is not set, by default, the cufile.log file is generated in the current working directory of the application.

Is that the case?

19-02-2023 06:10:38:318 [pid=97 tid=97] NOTICE  cufio-drv:705 running in compatible mode

This means that the system doesn't have a GDS-enabled storage device and drivers, so the GDS API call would execute the regular posix API without the benefit of GDS.

@mingxin-zheng
Copy link

Thanks @gigony for the reply.

wyli added a commit to Project-MONAI/MONAI that referenced this issue Mar 7, 2023
Fixes #6020

### Description

```
pip install cucim
python -c "import cucim"
```
may create a `cufile.log` file in the current working directory (please
see rapidsai/cucim#514)

this PR delays the cucim imports to when the modules are really needed. 

### Types of changes
<!--- Put an `x` in all the boxes that apply, and remove the not
applicable items -->
- [x] Non-breaking change (fix or new feature that would not break
existing functionality).
- [ ] Breaking change (fix or new feature that would cause existing
functionality to change).
- [ ] New tests added to cover the changes.
- [ ] Integration tests passed locally by running `./runtests.sh -f -u
--net --coverage`.
- [x] Quick tests passed locally by running `./runtests.sh --quick
--unittests --disttests`.
- [x] In-line docstrings updated.
- [ ] Documentation updated, tested `make html` command in the `docs/`
folder.

---------

Signed-off-by: Wenqi Li <wenqil@nvidia.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

4 participants