Math & Optimization · intermediate · concept 42 of 187
Embeddings
Dense vector representations that capture semantic meaning. Words, images, and even users can be embedded into continuous vector spaces where similar items are close together.
Interactive · 3D
Vectors in meaning-space, staged in 3D →
The embedding wall: token IDs become points where distance means similarity.
Key terms
Word2VecGloVeEmbedding spaceCosine similarityDimensionality
Learn these first
Where you meet it in the real world
Search engines, recommendation systems, RAG, semantic similarity
Videos
▶ Transformers, the tech behind LLMs | Deep Learning Chapter 5 ↗
3Blue1Brown · YouTube
▶ Word Embedding and Word2Vec, Clearly Explained!!! ↗
StatQuest with Josh Starmer · YouTube
Guides and articles
Courses, papers, and more
This unlocks