New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

请问这个框架支持continous-batching吗 #301

Open

00ffcc opened this issue Mar 7, 2024 · 2 comments

00ffcc commented Mar 7, 2024

吞吐量怎么样👀能支持高并发的请求吗

Owner

josStorer commented Mar 7, 2024 •

edited

目前不支持, 本项目处理并发是单纯的阻塞等待, 隔壁 https://github.com/Ai00-X/ai00_server 支持

Author

00ffcc commented Mar 7, 2024

感谢

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment