NLP & Language · intermediate · concept 123 of 311 · Updated Nov 4, 2026
Text Generation & Sampling
How LLMs produce text, sampling from probability distributions over tokens. Temperature controls randomness. Top-k and top-p (nucleus) sampling balance creativity and coherence.
Top AI contributors on this
- Dario AmodeiAnthropic
- Sam AltmanOpenAI
- Jeff DeanDiscovery Loop
- Noam ShazeerOpenAI
- Alec RadfordIndependent / Thinking Machines Lab (adviser)
- Oriol VinyalsDiscovery Loop
Key terms
TemperatureTop-kTop-p (nucleus)Beam searchGreedy decoding
Learn these first
Videos
▶ Large Language Models explained briefly ↗
3Blue1Brown · YouTube
▶ Attention in transformers, step-by-step | Deep Learning Chapter 6 ↗
3Blue1Brown · YouTube
Guides and articles
Courses, papers, and more