Encyclopedia · 176 concepts

Core ML Concepts · intermediate · concept 23 of 176

Regularization

Techniques to prevent overfitting by adding constraints to the model. L1 (Lasso) drives weights to zero for feature selection. L2 (Ridge) penalizes large weights. Dropout randomly disables neurons during training.

Key terms

L1/LassoL2/RidgeDropoutEarly stoppingWeight decay

Videos

Regularization Part 1: Ridge (L2) Regression

StatQuest with Josh Starmer · YouTube

Regularization Part 2: Lasso (L1) Regression

StatQuest with Josh Starmer · YouTube

Guides and articles