Skip to content

lucifertrj/Awesome-Fine-Tuning-LLMs

Repository files navigation

Awesome Fine Tune

For discussions and doubt-solving: Join Our Community

Notebooks

Large Language Models [Tasks: QA or Text Generation]

Dataset Base-Model Method+Runtime Colab Notebook
Custom CSV Orca Mini 3B Peft (T4) - SFT Open In Colab
alpaca-gpt4 (HF) Falcon-1B Full Fine Tuning + DeepSpeed Integration (T4) Open In Colab
Pubmed_qa Llama-2-7B-chat Peft (T4) - SFT Open In Colab
Custom CSV Llama-2-7B-chat Peft (T4) - SFT Open In Colab
codeparrot-train GPT-J-6B PyTorch Open In Colab

Language Models [Tasks: Text Classification]

Dataset Base-Model Method+Runtime Colab Notebook

Blogs

YouTube Short Course

About

Fine Tune LLama2 LLM model using LoRA - Peft. Plus implementation of Fast tokenizer

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published