Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

rt 模型无法下线 #340

Open
yz00000000 opened this issue Feb 19, 2024 · 1 comment
Open

rt 模型无法下线 #340

yz00000000 opened this issue Feb 19, 2024 · 1 comment
Assignees

Comments

@yz00000000
Copy link

yz00000000 commented Feb 19, 2024

基本信息:
组件版本:bisheng 0.2.2.5、rt 0.0.6.3
模型:Yi-6B
技能:PythonREPLTOOL + ZerpShotAgent + HostYiChat

对话过程中,陷入 循环,无超时等配置无法终止,GPU一直在计算
点击-模型-下线,状态一直是“下线中”,30分钟后下线成功。

期望:
1、rt模型,增加单次计算最长时间参数配置
2、模型-下线时,增加强行终止模型进程的逻辑或设定。

@PatrickStar-SJ
Copy link
Contributor

模型下线缓慢,内部没有复现,如果迟迟没有显示下线,可以尝试一下刷新页面。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants