Discussions

• 2 You must be logged in to vote

  🙏

  QLoRa with Vision Transformers

  anwai98 asked Apr 23, 2024 in Q&A · Unanswered

  

  

  2
• 1 You must be logged in to vote

  🙏

  How can I train the adalora about nn.Conv1d?

  girlsending0 asked Apr 11, 2024 in Q&A · Unanswered

  

  

  2
• 1 You must be logged in to vote

  💬

  Qlora + Deepspeed Zero3

  AnirudhVIyer started Apr 9, 2024 in General

  

  

  1
• 1 You must be logged in to vote

  🙏

  enable_input_require_grads is called twice with use_gradient_checkpointing=True and bnb quantisation; is there any effect?

  nzw0301 asked Apr 5, 2024 in Q&A · Answered

  

  

  2
• 1 You must be logged in to vote

  🙏

  prompt-tuning & p-tuning with Seq2Seq2LM t5

  whdnjsdyd111 asked Apr 5, 2024 in Q&A · Closed · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  The multi-task prompt tuning of PEFT library

  lhyscau asked Mar 25, 2024 in Q&A · Unanswered

  

  

  5
• 1 You must be logged in to vote

  🙏

  peft provides the position of the model input?

  ciaoyizhen asked Mar 19, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  How to train a custom model

  nguyenhoanganh2002 asked Mar 14, 2024 in Q&A · Answered

  

  

  12
• 1 You must be logged in to vote

  🙏

  What is the intended way of doing EMA with PEFT?

  samedii asked Mar 12, 2024 in Q&A · Answered

  

  

  10
• 2 You must be logged in to vote

  🙏

  Possible issue with whisper example notebook

  rosyvs asked Aug 1, 2023 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  What is the intended way of saving the base model when finetuning both an adapter and some layers in the base model?

  samedii asked Mar 9, 2024 in Q&A · Answered

  

  

  2
• 1 You must be logged in to vote

  💬

  Vision Foundation Model deployment in the edge cases - How adapters will be useful to deploy VFM in the edge device?

  solomonmanuelraj started Dec 15, 2023 in General

  

  

  

  

  4
• 1 You must be logged in to vote

  🙏

  Load and unload different LORAs during training

  antoni4040 asked Feb 14, 2024 in Q&A · Unanswered

  

  

  3
• 1 You must be logged in to vote

  🙏

  Resume training from a checkpoint with different hyperparameters when training with transformers

  jonflynng asked Feb 16, 2024 in Q&A · Unanswered

  

  

  1
• 4 You must be logged in to vote

  🙏

  Is there any way to extract lora adapter from merged model?

  tjtanaa asked Dec 5, 2023 in Q&A · Unanswered

  

  

  

  

  6
• 1 You must be logged in to vote

  💬

  Train Embedding Layer with LoRA

  RADxEEn started Feb 6, 2024 in General · Closed

  

  

  10
• 1 You must be logged in to vote

  🙏

  Multitask Prompt Tuning Confusion

  atastats asked Feb 1, 2024 in Q&A · Unanswered

  

  

  

  

  5
• 1 You must be logged in to vote

  💬

  rslora guidance for alpha value?

  andysalerno started Jan 23, 2024 in General

  

  

  1
• 13 You must be logged in to vote

  💬

  Hallucinations with 8bit Whisper PEFT model - solved with full / half precision

  sanchit-gandhi started May 19, 2023 in General

  

  

  

  

  5
• 1 You must be logged in to vote

  💡

  What are thoughts on Tied-LoRA?

  Maykeye started Jan 11, 2024 in Ideas

  

  

  1
• 3 You must be logged in to vote

  💬

  How to train multiple LoRA adapters on the same base model concurrently.

  rajat95 started Jan 1, 2024 in General

  

  

  3
• 1 You must be logged in to vote

  🙏

  Got Error on Fine-tuning TrOCR with LoRA

  bustamiyusoef asked Dec 30, 2023 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Inference with a PEFT adapter is slow

  alexflint asked Jul 10, 2023 in Q&A · Unanswered

  

  

  

  

  5
• 1 You must be logged in to vote

  🙏

  Are there any plans to implement concurrent LoRa inference with multiple adapters (such as S-lora)?

  SamGalanakis asked Dec 8, 2023 in Q&A · Unanswered

  

  

  3
• 1 You must be logged in to vote

  🙏

  Recovering the Learnt Prompt in text

  pharringtonp19 asked Dec 12, 2023 in Q&A · Unanswered

  

  

  4