[FEATURE] Training with QLoRA + FSDP

[pascal-pfeiffer]

🚀 Feature

New advancements bringing quantized LoRA and FSDP together.
https://github.com/AnswerDotAI/fsdp_qlora

Motivation

Train larger models on consumer GPUs or older generation Data Center GPUs such as V100
Lets you finetune Llama-2 70B on dual 24GB GPUs.