Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

LoRA adapter checkpoints not downloadable #141

Open
kibru9399 opened this issue Oct 21, 2023 · 6 comments
Open

LoRA adapter checkpoints not downloadable #141

kibru9399 opened this issue Oct 21, 2023 · 6 comments

Comments

@kibru9399
Copy link

I am not able to download the LoRA adabters for the NLU task this week, is there any other place I can find them?

@edwardjhu
Copy link
Collaborator

The checkpoints are hosted on GitHub. Which one are you having trouble downloading?

@kibru9399
Copy link
Author

thank you for answering, the one one this page, but i was able to find it on your other page, I have on question on the mnli(3-class classificatiton) LoRA adapter, you said that we should use the deberta-v2-xxl(from huggingface) as a base model to use with the adater, however, the deberta-v2-xxl model on huggingface doesnt have a classifier head(for the 3 class), how can we reproduce your result(97% accuracy) using your LoRA adapter if we cant find the classifier head? I hope what I am saying make sense. LoRA adapter is only for the attention matrices, how are we suppose to get the weight of the classifier head for mnli task, the base deberta-v2-xxl doesnt have a trained classifier head for this task.
THANK YOU FOR YOUR ATTENTION.

@xumingyu2021
Copy link

I also have trouble downloading withall on the page https://github.com/microsoft/LoRA/tree/main/examples/NLU, and am not able to find it on your other page....

@Edenzzzz
Copy link

Edenzzzz commented Dec 5, 2023

The checkpoints are hosted on GitHub. Which one are you having trouble downloading?

None of the checkpoints can be downloaded

@rensushan
Copy link

None of the checkpoints on the page https://github.com/microsoft/LoRA/tree/main/examples/NLU can be downloaded.

@zxchasing
Copy link

thank you for answering, the one one this page, but i was able to find it on your other page, I have on question on the mnli(3-class classificatiton) LoRA adapter, you said that we should use the deberta-v2-xxl(from huggingface) as a base model to use with the adater, however, the deberta-v2-xxl model on huggingface doesnt have a classifier head(for the 3 class), how can we reproduce your result(97% accuracy) using your LoRA adapter if we cant find the classifier head? I hope what I am saying make sense. LoRA adapter is only for the attention matrices, how are we suppose to get the weight of the classifier head for mnli task, the base deberta-v2-xxl doesnt have a trained classifier head for this task. THANK YOU FOR YOUR ATTENTION.

hello,I am not reproducing the mnli task with the accuracy described in the paper, what does the mention of using LoRA adapter model mean? Have you solved it now?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

6 participants