Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

gpu memory issue #25

Open
babbu3682 opened this issue May 6, 2020 · 1 comment
Open

gpu memory issue #25

babbu3682 opened this issue May 6, 2020 · 1 comment

Comments

@babbu3682
Copy link

babbu3682 commented May 6, 2020

I have a problem with the Encoder model. I wanted to make the CRNN from scratch so I build my custom CNN encoder model like "Efficientnet-b0", it is worked but after 2 steps the gpu memory errors show up. I think GPU memory is stacked every step because of "for() function" in forward(). So, how can I solve that problem?

1 epoch
image

2 epoch
image

3 epoch
image

4 epoch
image

as you can see above, the memory increase until CUDA out of error .....

@HHTseng
Copy link
Owner

HHTseng commented May 6, 2020

Sorry that I was not able to conceive where the problem may be without knowing more details how your new model "Efficientnet-b0" is constructed. I do not recognize this type of error from my experience.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants