Skip to content
This repository has been archived by the owner on Mar 19, 2024. It is now read-only.

Example of using ZeRO and LARC #561

Open
crypdick opened this issue Aug 10, 2022 · 0 comments
Open

Example of using ZeRO and LARC #561

crypdick opened this issue Aug 10, 2022 · 0 comments

Comments

@crypdick
Copy link

馃摎 VISSL Documentation

The docs for ZeRO gives an example of using ZeRO + LARC. However, the example has use_larc: False, which is confusing.

This should either be set to use_larc: True, or a note should be added that LARC will be used even if set to False here.

Thanks!

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant