NLP & Language · intermediate · concept 84 of 176
Text Generation & Sampling
How LLMs produce text, sampling from probability distributions over tokens. Temperature controls randomness. Top-k and top-p (nucleus) sampling balance creativity and coherence.
Key terms
TemperatureTop-kTop-p (nucleus)Beam searchGreedy decoding
Learn these first
Videos
▶ Large Language Models explained briefly ↗
3Blue1Brown · YouTube
▶ Attention in transformers, step-by-step | Deep Learning Chapter 6 ↗
3Blue1Brown · YouTube
Guides and articles
Courses, papers, and more
This unlocks