Core ML Concepts · intermediate · concept 27 of 311 · Updated Nov 4, 2026
Regularization
Techniques to prevent overfitting by adding constraints to the model. L1 (Lasso) drives weights to zero for feature selection. L2 (Ridge) penalizes large weights. Dropout randomly disables neurons during training.
Top AI contributors on this
- Michael I. JordanInria Paris / UC Berkeley (emeritus)
- John HopfieldPrinceton University (emeritus)
- Cassie KozyrkovIndependent (formerly Google)
- Chelsea FinnStanford University / Physical Intelligence
- Daphne Kollerinsitro
- Sébastien BubeckOpenAI
Key terms
L1/LassoL2/RidgeDropoutEarly stoppingWeight decay
Learn these first
Videos
▶ Regularization Part 1: Ridge (L2) Regression ↗
StatQuest with Josh Starmer · YouTube
▶ Regularization Part 2: Lasso (L1) Regression ↗
StatQuest with Josh Starmer · YouTube
Guides and articles
This unlocks