Core ML Concepts · intermediate · concept 22 of 176
Transfer Learning
Using a model trained on one task as the starting point for a different task. Instead of training from scratch, you fine-tune a pretrained model, dramatically reducing data and compute requirements. Multi-task learning is the sibling trick: one model trained on several tasks at once, sharing what transfers.
Key terms
Pre-trainingFine-tuningDomain adaptationFeature extractionMulti-task learning
Learn these first
Where you meet it in the real world
Medical imaging with limited data, NLP with pretrained LLMs, custom image classifiers
Videos
▶ Lec 18. Transfer Learning: Models ↗
MIT OpenCourseWare · YouTube
▶ 4: Deep Learning for Computer Vision – Transfer Learning and Fine-Tuning; Intro to HuggingFace ↗
MIT OpenCourseWare · YouTube
Guides and articles
Courses, papers, and more
This unlocks