QLoRA

A memory-efficient fine-tuning scheme combining 4-bit quantization with LoRA.

QLoRA quantizes the model to 4-bit and trains LoRA adapters on top, letting consumer GPUs fine-tune 70B-class models. Training is a bit slower, but it is a game-changer for individuals and small teams.