New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Bug] yi-34B-chat-200k返回不全 #2408
Comments
Thank you for raising an issue. We will investigate into the matter and get back to you as soon as possible. |
@MapleEve 来帮忙看看? |
Also, does this problem occur once or often? |
我稍微看了下,目前官方已经更新了模型名称,如果你是直连的话(非 Ollama 自部署的),等下面这个 PR 通过之后你再试试新的模型名称。 另外200K 的模型丢失注意力的情况如果不是回复异常中断(在 Chrome 的开发者工具界面会显示链接主动断开),就是模型自身 RAG 的问题。所以我需要一个重现出来的时候,谷歌开发者工具的控制台/网络连接内容。 |
I took a look and found that the official model name has been updated. If you are directly connected (non-Ollama self-deployed), you can try the new model name after the PR below is passed. In addition, if the 200K model loses attention, if it is not abnormal interruption of reply (the link will be actively disconnected in Chrome's developer tools interface), it is a problem with the RAG of the model itself. So I need a way to reproduce the console/network connection content of Google Developer Tools. |
This issue is closed, If you have any questions, you can comment and reply. |
💻 系统环境
Windows
📦 部署环境
Official Preview
🌐 浏览器
Chrome
🐛 问题描述
使用yi-34B-chat-200k时出现返回不全的问题,回复继续也没有输出剩余内容
🚦 期望结果
No response
📷 复现步骤
No response
📝 补充信息
No response
The text was updated successfully, but these errors were encountered: