Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: 本地部署的模型切换时,如果不等模型A分配到显卡上就切换另外一个模型B,会导致显示B而实际上调用A #1126

Open
2 tasks done
Patrick-Ni opened this issue May 13, 2024 · 0 comments
Assignees
Labels
bug Something isn't working

Comments

@Patrick-Ni
Copy link

这个bug是否已存在现有issue了?

  • 我确认没有已有issue,且已阅读常见问题

错误表现

本地部署的模型切换时,如果不等模型A分配到显卡上就切换另外一个模型B,会导致显示B而实际上调用A
image
是否可以在部署模型时禁止用户切换模型?或者放弃当前的部署,转而部署新的模型

复现操作

1.正常完成本地部署
2.切换qwen-7b-chat模型时,没有等待模型分配到显卡上就切换模型qwen-14b-chat
3.实际回复时仍然调用的是qwen-7b-chat

错误日志

No response

运行环境

  • OS: Centos 8
  • Browser: chrome
  • Gradio version: 3.43.2
  • Python version: 3.10

帮助解决

  • 我愿意协助解决!

补充说明

No response

@Patrick-Ni Patrick-Ni added the bug Something isn't working label May 13, 2024
@Keldos-Li Keldos-Li self-assigned this May 14, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants