-
I was trying to utilize multiple cards when using DPA-2, but in practice, only one card was being invoked, leading to insufficient memory. I have four GPUs with 16GB each. However, it indicates that the memory of the first GPU is insufficient, suggesting that only the first GPU is being utilized. So why doesn't DPA-2 support multi-card operation? |
Beta Was this translation helpful? Give feedback.
Answered by
iProzd
Apr 24, 2024
Replies: 1 comment 2 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
@wangyi01 You should use
--model-branch
instead of-m
(which is short for--mpi-log
) during finetuning.