NLP & Language · advanced · concept 95 of 176
Fine-Tuning LLMs
Adapting a pretrained LLM to a specific task or domain by training on additional data. LoRA and QLoRA enable efficient fine-tuning by only updating a small fraction of parameters.
Key terms
LoRAQLoRAPEFTInstruction tuningAdapter layers
Learn these first
Videos
▶ [1hr Talk] Intro to Large Language Models ↗
Andrej Karpathy · YouTube
▶ Is Fine-Tuning Still Needed? LLMs, RAG, & LoRA ↗
IBM Technology · YouTube
Guides and articles
Courses, papers, and more
This unlocks