Math & Optimization · intermediate · concept 42 of 176
Dimensionality Reduction
Reducing the number of features while preserving important information. PCA, t-SNE, and UMAP are the main techniques, essential for visualization and fighting the curse of dimensionality. LDA is the supervised counterpart: it projects using class labels, where PCA ignores them.
Key terms
PCAt-SNEUMAPCurse of dimensionalityFeature compressionLDA (Linear Discriminant Analysis)
Learn these first
Videos
▶ UMAP Dimension Reduction, Main Ideas!!! ↗
StatQuest with Josh Starmer · YouTube
▶ StatQuest: PCA main ideas in only 5 minutes!!! ↗
StatQuest with Josh Starmer · YouTube
Guides and articles
Courses, papers, and more