NLP & Language · intermediate · concept 90 of 176

🗣️LoRA & Parameter-Efficient Fine-Tuning

Instead of updating billions of weights, LoRA freezes the model and trains two small low-rank matrices per layer, often under one percent of the parameters. Fine-tuning that needed a cluster now fits on one consumer GPU, and swapping adapters swaps skills without touching the base model.