Encyclopedia · 187 concepts

NLP & Language · intermediate · concept 85 of 187

Text Generation & Sampling

How LLMs produce text, sampling from probability distributions over tokens. Temperature controls randomness. Top-k and top-p (nucleus) sampling balance creativity and coherence.

Key terms

TemperatureTop-kTop-p (nucleus)Beam searchGreedy decoding

Learn these first

Videos

Guides and articles

Courses, papers, and more

This unlocks