-
Notifications
You must be signed in to change notification settings - Fork 703
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Tensorflow 1.x backend: add dropout to DeepONet #1579
base: master
Are you sure you want to change the base?
Conversation
Do you use dropbox to prevent overfitting? |
Yes, I'm using dropout_rate right now during hyperparameter tuning. I'll write how useful it is in my case. |
I am curious how useful it is. In general, I found dropout is not that useful, and L1/L2 regularization seems good enough. |
Hyperparameter tuning showed that in my case neither dropout nor regularization is required. However I will use dropout anyway for UQ. |
Yes, dropout is useful for UQ. How do you implement DeepONet UQ? |
I just run
|
In fact, we have this callback https://deepxde.readthedocs.io/en/latest/modules/deepxde.html#deepxde.callbacks.DropoutUncertainty . Does this work for your case? |
Yes, I used |
Now DeepONet supports dropout technique.