#

peft-fine-tuning-llm

Here are 16 public repositories matching this topic...

nbasyl / DoRA

Official implementation of "DoRA: Weight-Decomposed Low-Rank Adaptation"

lora dora vllm peft-fine-tuning-llm

Updated Apr 28, 2024

liuqidong07 / MOELoRA-peft

[SIGIR'24] The official implementation code of MOELoRA.

multi-task peft multitask-learning mixture-of-experts large-language-models chatglm low-rank-adaptation parameter-efficient-fine-tuning peft-fine-tuning-llm

Updated Apr 1, 2024
Python

NOLA

UCDvision / NOLA

Code for NOLA, an implementation of "nola: Compressing LoRA using Linear Combination of Random Basis"

transformers vision lora peft large-language-models peft-fine-tuning-llm

Updated May 3, 2024
Python

brown-palm / AntGPT

Official code implemtation of paper AntGPT: Can Large Language Models Help Long-term Action Anticipation from Videos?

deep-learning peft vision-and-language video-forecasting gpt4 large-language-models gpt-35-turbo llama2 peft-fine-tuning-llm

Updated Mar 16, 2024
Python

misonsky / HiFT

memory-efficient fine-tuning; support 24G GPU memory fine-tuning 7B

transformers lora pytorch-implementation huggingface-transformers large-language-models chinese-llama-65b llama2 chinese-llama memory-efficient-tuning peft-fine-tuning-llm llama3

Updated May 7, 2024
Python

sayan112207 / Text2SQL

Fine-tune StarCoder2-3b for SQL tasks on limited resources with LORA. LORA reduces model size for faster training on smaller datasets. StarCoder2 is a family of code generation models (3B, 7B, and 15B), trained on 600+ programming languages from The Stack v2 and some natural language text such as Wikipedia, Arxiv, and GitHub issues.

stack lora fine-tuning peft peft-fine-tuning-llm starcoder2

Updated Apr 9, 2024
Jupyter Notebook

himanshuvnm / Foundation-Model-Large-Language-Model-FM-LLM

This repository was commited under the action of executing important tasks on which modern Generative AI concepts are laid on. In particular, we focussed on three coding actions of Large Language Models. Extra and necessary details are given in the README.md file.

aws python3 pytorch lora rnn-pytorch attention-is-all-you-need fine-tuning hate-speech-detection huggingface huggingface-transformers foundation-models large-language-models generative-ai rlhf flan-t5 peft-fine-tuning-llm ml-m5-2xlarge low-rank-ada

Updated Mar 28, 2024
Jupyter Notebook

pankajrawat9075 / Dialog-Summarization-with-Generative-AI

Using Open-Source LLMs like FLAN-T5, built a Dialog Summarization model and did fine-tuning with DialogSum HF Dataset

summarization fine-tuning huggingface generative-ai flan-t5 peft-fine-tuning-llm

Updated Apr 25, 2024
Jupyter Notebook

babadue / unfathomableAI

Stumble upon a fine tuning that is unfathomable.

ai fine-tuning-llm unfathomable peft-fine-tuning-llm unfathomable-ai

Updated Feb 13, 2024
Jupyter Notebook

nithin-kamal / Dialogue-Summary-using-LLMs

Dialogue Summary LLM - FLAN - T5: An implementation of the Flan-t5 LLM to summarize dialogues. Prompt Engineering , Fine tuning with PEFT and fine tuning with RL (PPO) is explored within this project.

natural-language-processing reinforcement-learning ppo prompt-engineering llms generative-ai flan-t5 peft-fine-tuning-llm

Updated Feb 19, 2024
Jupyter Notebook

polarbeargo / GenAIND-Apply-Lightweight-Fine-Tuning-LLMs

transformers lora wandb segformer llms peft-fine-tuning-llm

Updated Mar 11, 2024
Jupyter Notebook

myrondza10 / llama2-llm-genai

This repo contains implementations of fine-tuning LLaMA LLM model using LoRA weights (PEFT) as well as focuses on the Retrieval Augmented Generation (RAG) framework.

rag large-language-models peft-fine-tuning-llm

Updated Mar 25, 2024
Jupyter Notebook

jordandeklerk / OracleCoder

A QLoRA+ LLM Ensemble with Schema-Linking for Text-to-SQL Generation

machine-learning deep-learning artificial-intelligence lora llms peft-fine-tuning-llm

Updated Apr 9, 2024
Jupyter Notebook

nikhil-chigali / AdapterBERT

This project is an implementation of the paper: Parameter-Efficient Transfer Learning for NLP, Houlsby [Google], ICML 2019.

pytorch adapters bert peft pytorch-implementation bert-fine-tuning parameter-efficient-tuning llms peft-fine-tuning-llm

Updated Mar 17, 2024
Python

ishwar6 / transformers

This repo contains everything about transformers and NLP.

nlp deep-learning cuda pytorch embeddings transformer lora tensors nlp-machine-learning tokenization fine-tuning nlp-datasets bert-embeddings huggingface huggingface-transformers python-nlp-projects qlora fine-tuning-llm peft-fine-tuning-llm

Updated May 9, 2024
Python

SkyuForever / CRE-LLM

CRE-LLM: A Domain-Specific Chinese Relation Extraction Framework with Fine-tuned Large Language Model

nlp chinese relation-extraction fine-tuning domain-specific large-language-models peft-fine-tuning-llm

Updated Apr 27, 2024
Python

Improve this page

Add a description, image, and links to the peft-fine-tuning-llm topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the peft-fine-tuning-llm topic, visit your repo's landing page and select "manage topics."