We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
发现一个问题,因为微调为保存得到的是pt, 然后使用pth_to_hf后,保存为safetensor的形式,再多卡测试时载入,发现显存占用超过80g,但是将其保存为bin形式,每张卡显存均保持在30g,这是为什么呢,能否转换为hf的时候直接变成bin呢
The text was updated successfully, but these errors were encountered:
@zwhus 在 v0.1.19 版本中,我们将默认的保存格式改为了 bin,如果想保存 safetensor,可加添加 --safe-serialization
--safe-serialization
#648
Sorry, something went wrong.
No branches or pull requests
发现一个问题,因为微调为保存得到的是pt, 然后使用pth_to_hf后,保存为safetensor的形式,再多卡测试时载入,发现显存占用超过80g,但是将其保存为bin形式,每张卡显存均保持在30g,这是为什么呢,能否转换为hf的时候直接变成bin呢
The text was updated successfully, but these errors were encountered: