The learning rate schedule is generally incorrect when max_steps
is not set
#65
Labels
bug
Something isn't working
max_steps
is not set
#65
Describe the bug
There is a bug in NeMo that prevents the learning rate schedule from working as expected when
max_steps
is not set.The fix is in NVIDIA/NeMo#7518, and the purpose of this issue is to keep track of this bug as it affects several algorithms in NeMo-Aligner.
The text was updated successfully, but these errors were encountered: