Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

对 Baichuan 1 的推理优化迁移到 Baichuan 2后，原来在baichuan1上微调的模型无法做推理 #380

Open
FangNera opened this issue Feb 29, 2024 · 3 comments
Open

对 Baichuan 1 的推理优化迁移到 Baichuan 2后，原来在baichuan1上微调的模型无法做推理 #380

FangNera opened this issue Feb 29, 2024 · 3 comments

Comments

@FangNera
Copy link

FangNera commented Feb 29, 2024 •
edited

我先根据readme把baichuan2-13B-Chat做了转换，转换后也可以作为基座模型再train。现在我想用原来在baichuan1上训练的模型做推理，后台不报错，前端web显示0.
issue1
web
@FangNera FangNera changed the title 对 Baichuan 1 的推理优化迁移到 Baichuan 2后，原理在baichuan1上微调的模型无法做推理 对 Baichuan 1 的推理优化迁移到 Baichuan 2后，原来在baichuan1上微调的模型无法做推理 Feb 29, 2024
@FangNera
Copy link
Author

是否需要更新template，因为baichuan2的起停符与baichuan1的不一样。但我看readme并没有说要更新

@guoqiangqi
Copy link

你好，我也在尝试baichuan2转换baichuan1，方便交流下吗

@FangNera
Copy link
Author

你好，我也在尝试baichuan2转换baichuan1，方便交流下吗

后来就直接用原来的数据重训了。你遇到的啥问题呀？

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@guoqiangqi @FangNera