You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Opening this so I can track how to add this to ao and make sure it works well with torch.compile(). This will likely need blackwell to perform decently
The code is out, it's quite simple and short
Opening this so I can track how to add this to ao and make sure it works well with torch.compile(). This will likely need blackwell to perform decently
https://github.com/microsoft/unilm/blob/master/bitnet/The-Era-of-1-bit-LLMs__Training_Tips_Code_FAQ.pdf
The text was updated successfully, but these errors were encountered: