Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cannot use GPU when output.shape[1] * nnz(a) > 2^31 #51

Open
ahukui opened this issue Aug 28, 2019 · 10 comments
Open

Cannot use GPU when output.shape[1] * nnz(a) > 2^31 #51

ahukui opened this issue Aug 28, 2019 · 10 comments

Comments

@ahukui
Copy link

ahukui commented Aug 28, 2019

When I use the gcn layer, I always meets this problem.

InvalidArgumentError: 2 root error(s) found.
(0) Invalid argument: Cannot use GPU when output.shape[1] * nnz(a) > 2^31
[[node graph_convolution_23/SparseTensorDenseMatMul/SparseTensorDenseMatMul (defined at /home/labadmin/anaconda2/lib/python2.7/site-packages/keras/backend/tensorflow_backend.py:1083) ]]
[[loss_3/add_2/_677]]
(1) Invalid argument: Cannot use GPU when output.shape[1] * nnz(a) > 2^31
[[node graph_convolution_23/SparseTensorDenseMatMul/SparseTensorDenseMatMul (defined at /home/labadmin/anaconda2/lib/python2.7/site-packages/keras/backend/tensorflow_backend.py:1083) ]]
0 successful operations.
0 derived errors ignored.

@zhouchunpong
Copy link

I meet this problem too !

@cquzys
Copy link

cquzys commented Dec 14, 2019

hello, do you solve it? can you share your method? thanks

@ahukui
Copy link
Author

ahukui commented Dec 16, 2019

No

@ahukui
Copy link
Author

ahukui commented Dec 18, 2019 via email

@innekemayachita
Copy link

Is there any solution on this issue?

@icoric4
Copy link

icoric4 commented Apr 16, 2021

@innekemayachita Have you found anything maybe?

@YingtongDou
Copy link

You can cast the sparse matrix to dense matrix and use tf.matmul

@b3326023
Copy link

Same problem here.

@b3326023
Copy link

b3326023 commented Jun 22, 2021

You can cast the sparse matrix to dense matrix and use tf.matmul

But if we have a large matrix with most of zero, we would like to use sparse matrix, so shouldn't cast to dense matrix

@krobasky
Copy link

I had this problem on tensorflow 2.4.1, it went away when I upgraded to 2.5 + cuda lib v11; I don't know if the trouble was with the tensorflow version, cuda, or both.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

8 participants