You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hi, I noticed in scripts/eval/bbh.sh, if two or more CUDA devices are available, for example, CUDA_VISIBLE_DEVICES=0,1, it will give "Expected all tensors to be on the same device, but found at least two devices" error. If using auto instead of balanced_low_0 for device_map, then it is fine. I am wondering probably I am missing something? Thanks!
The text was updated successfully, but these errors were encountered:
Hi, I noticed in
scripts/eval/bbh.sh
, if two or more CUDA devices are available, for example,CUDA_VISIBLE_DEVICES=0,1
, it will give "Expected all tensors to be on the same device, but found at least two devices" error. If usingauto
instead ofbalanced_low_0
for device_map, then it is fine. I am wondering probably I am missing something? Thanks!The text was updated successfully, but these errors were encountered: