Core ML Concepts · intermediate · concept 21 of 176
Bias-Variance Tradeoff
Bias: error from overly simplistic assumptions (underfitting). Variance: error from sensitivity to training data fluctuations (overfitting). The tradeoff is fundamental, reducing one often increases the other. Every architecture also carries an inductive bias, assumptions baked into its structure, like CNNs assuming nearby pixels matter most.
Key terms
BiasVarianceTradeoffModel complexityGeneralizationInductive bias
Learn these first
Videos
▶ Machine Learning Fundamentals: Bias and Variance ↗
StatQuest with Josh Starmer · YouTube
▶ Statistical Learning: 2.3 Model Selection and Bias Variance Tradeoff ↗
Stanford Online · YouTube
Guides and articles