New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Dynamic LoRA switching #1686

Open

MrigankRaman opened this issue Apr 27, 2024 · 1 comment

Labels

MrigankRaman commented Apr 27, 2024 •

edited

Hi! This has been an awesome project and helped me a lot. I was wondering can we get dynamic lora switching in ctranslate2? Afaik TensorRTLLM has it

minhthuc2502 added the enhancement label

Contributor

anterart commented May 6, 2024

I would also like to have this feature as well 🙂

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment