Math & Optimization · intermediate · concept 63 of 311 · Updated Nov 4, 2026

📐Boosting (XGBoost, LightGBM)

An ensemble technique that combines many weak learners (usually decision trees) sequentially, with each new tree correcting the errors of previous ones. XGBoost and LightGBM dominate Kaggle competitions.