Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Possible memory leakage issue in using gunrock::sssp::run #1037

Open
lxrzlyr opened this issue Mar 17, 2023 · 5 comments
Open

Possible memory leakage issue in using gunrock::sssp::run #1037

lxrzlyr opened this issue Mar 17, 2023 · 5 comments
Assignees
Labels
🐛 bug Use to report bugs in the issues or fix bugs in a pull request.

Comments

@lxrzlyr
Copy link

lxrzlyr commented Mar 17, 2023

Describe the bug
There might be a GPU memory leak issue in the gunrock::sssp::run function in Gunrock during runtime.

To Reproduce
The issue can be reproduced by calling the function multiple times in a loop. The following code snippet is provided as an example:

for (auto i = 0; i < n_vertices; i++) {
single_source = i;
gpu_elapsed += gunrock::sssp::run(G, single_source, distances.data().get(), predecessors.data().get());
}

Replace lines 76-82 in examples/algorithms/sssp/sssp.cu with the provided code and compile the sssp, then the issue can be reproduced.

Expected behavior
The entire graph should be computed without any GPU memory overflow issues.

Screenshots
2023-03-16 08-13-19屏幕截图
2023-03-16 08-22-21屏幕截图
2023-03-16 08-24-32屏幕截图
2023-03-16 08-31-53屏幕截图
2023-03-16 08-41-41屏幕截图

Environment (please complete the following information):
Ubuntu 20.04
NVIDIA Driver Version: 470.161.03
CUDA Version: 11.4
GCC/G++: 9.4.0

Additional context
Add any other context about the problem here.

@lxrzlyr lxrzlyr added the 🐛 bug Use to report bugs in the issues or fix bugs in a pull request. label Mar 17, 2023
@neoblizz neoblizz self-assigned this Mar 17, 2023
@neoblizz
Copy link
Member

Thank you, as I promised in the email, I will take a look at it!

@lxrzlyr
Copy link
Author

lxrzlyr commented Mar 17, 2023 via email

@neoblizz
Copy link
Member

neoblizz commented Mar 20, 2023

Been looking at it and it maybe trickier than I thought. I'll let you know in this issue if I find a fix.

@lxrzlyr
Copy link
Author

lxrzlyr commented Mar 26, 2023

Dear Gunrock maintainers,
I recently noticed that the latest release of Gunrock supports only up to two parameters, and it appears that the previous performance test scripts may no longer be applicable. I'm wondering if Gunrock still offers other interfaces for performance testing? Specifically, my concern is related to the throughput metrics of the SSSP API.
Thank you very much for your support and assistance.
2023-03-26 17-46-47屏幕截图

@neoblizz
Copy link
Member

In the develop branch git checkout develop we now have means to collect the previously available metrics and export them into a JSON file: https://github.com/gunrock/gunrock/blob/develop/examples/algorithms/sssp/sssp.cu

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
🐛 bug Use to report bugs in the issues or fix bugs in a pull request.
Projects
None yet
Development

No branches or pull requests

2 participants