Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

GPU and memory columns not present #794

Open
aibtw opened this issue Mar 18, 2024 · 7 comments
Open

GPU and memory columns not present #794

aibtw opened this issue Mar 18, 2024 · 7 comments

Comments

@aibtw
Copy link

aibtw commented Mar 18, 2024

Describe the bug
I am trying to get GPU profiling, but in the cli and the html there is no column for that.

To Reproduce
I used this command:
scalene --cpu --gpu ./my_script.py

Expected behavior
I see images on this repo of what the profiling result should be like. Mine is nothing like that. see below

Screenshots
image

Desktop:

  • OS: ubuntu 22.04
  • Browser: Mozilla Firefox 122.0.1
@emeryberger
Copy link
Member

Hardware platform? What happens when you run nvidia-smi? (Scalene's GPU support is currently limited to NVIDIA.)

@aibtw
Copy link
Author

aibtw commented Mar 18, 2024

Hardware platform? What happens when you run nvidia-smi? (Scalene's GPU support is currently limited to NVIDIA.)

sorry, forgot the details:

  • Intel i7-13700 with RTX 3080.
  • Also tried on Jetson Orin 16GB and got same issue, but let's not focus on this.
  • I will add that I tried different versions (latest from github, 1.5.19, I don't remember the rest, but I tried multiple ones in this range)
  • Python version 3.8

@emeryberger
Copy link
Member

The usual issue here is an old driver, but let's be sure. Please run nvidia-smi and paste the output here.

@aibtw
Copy link
Author

aibtw commented Mar 18, 2024

I see

here is the output of nvidia-smi while the scalene is running
image

Is it a CUDA version issue?

@emeryberger
Copy link
Member

The driver version is a little bit on the old side (released in 2022); if you can update it to the latest version, please do and let's see what happens. In my experience, this usually resolves the problem.

@emeryberger
Copy link
Member

@aibtw any updates?

@aibtw
Copy link
Author

aibtw commented Mar 19, 2024

Sorry, been testing it with different conditions.
So, after I updated the driver to 530,
image

I setup a new venv to test it.

If I run it on a non-threaded application, it seems to work
image
(but GPU memory result doesn't seem right to me)

However, my application is threaded. If I run it, it is still the same.
image

So, does it work for threaded applications?

I really like the tool. Appreciate your effort in trying to solve this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants