You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Initialization does not take weights into account (unless there is normalization). Need to think of a general way to account for weights in the initialization.
Maybe scale values by square root of weight? That would be similar to what is being done with normalization, I think.
The text was updated successfully, but these errors were encountered:
Initialization does not take weights into account (unless there is normalization). Need to think of a general way to account for weights in the initialization.
Maybe scale values by square root of weight? That would be similar to what is being done with normalization, I think.
The text was updated successfully, but these errors were encountered: