Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

What kind of HW is needed to run the "best performing model"? #27

Open
KDuzinkiewicz opened this issue Dec 4, 2018 · 2 comments
Open

Comments

@KDuzinkiewicz
Copy link

Hi,
I have a setup with NVIDIA GTX 1080 card with 8GB RAM but I'm still unable to perform a successfull denoising run on the default dataset without getting an out-of-memory error from TensorFlow :(
I'm currently retraining the model with a smaller "dilations" parameter value, but just out of curiosity - what kind of HW are you using to run denoising without OOM error on your side?

@jordipons
Copy link

We used a Titan X Pascal (12GB-VRAM).

Actually, having enough VRAM is important for these wavenet-like models.

Maybe you can check our recent paper where we explore several hyper-parameters choices with the idea to investigate that memory issue. See in Section 3 the paragraph "Wavenet: wider or deeper?": https://arxiv.org/abs/1810.12187

@KDuzinkiewicz
Copy link
Author

Thanks for your answer! BTW, have you used the same card for training & denoising? My problem is that even on a setup with 2 x 10GB cards I'm unable to go higher than dilations=6 during training.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants