This repository has been archived by the owner on Oct 9, 2023. It is now read-only.
Exclude parameters from weight decay #1461
Unanswered
rohan-mehta-1024
asked this question in
Data / pipelines
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I am wondering how to exclude parameters from weight decay when using LARS? Do I have to manually annotate the parameters somehow? I have looked at the source code for the LARS optimizer but am still confused.
Beta Was this translation helpful? Give feedback.
All reactions