Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

微调后，回答结果被上下文影响该怎么解决 #918

Closed
cjq345994512 opened this issue May 13, 2024 · 2 comments
Closed

微调后，回答结果被上下文影响该怎么解决 #918

cjq345994512 opened this issue May 13, 2024 · 2 comments

Comments

@cjq345994512
Copy link

微调大模型后，没有历史上下文时，问训练集中的问题，能回答正确。
但当有历史上下文时，再问训练集种的问题，会按历史上下文的回答内容格式去回答
这种情况需要怎么解决
@tastelikefeet
Copy link
Collaborator

增加数据集多样性，混合一些其他数据集一起训练

@cjq345994512
Copy link
Author

尝试了增加到5000条和10000条 仍然有这个问题，而且是千问、百川、chatGLm、yi、这些模型都有这个问题。
还有其他解决办法吗

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@tastelikefeet @cjq345994512