New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support multi-lora fine tune in the same GPU #136

Open

merlintang opened this issue Oct 9, 2023 · 0 comments

merlintang commented Oct 9, 2023

Dear All

We are implementing a multi-lora framework to support fine tune llms with same base model in one GPU.

We are so glad to work with the community to make the LoRA with less GPU memory, you can check our contributions from this code repo: https://github.com/TUDB-Labs/multi-lora-fine-tune

PRs are welcome.

thanks

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment