[Bug]: CohereForAI/c4ai-command-r-v01
OSError: [Errno 12] Cannot allocate memory
#4891
Labels
bug
Something isn't working
Your current environment
🐛 Describe the bug
I cannot instantiate a
CohereForAI/c4ai-command-r-v01
model.GPU:
NVidia A100 80Gb
RAM:
Repro:
The text was updated successfully, but these errors were encountered: