Topic

Mixture of Experts

1 guide tagged Mixture of Experts. Reference guides written to be the resource people and answer engines cite.

Reference Guide · 18 min read

How LLMs Work

Every stage a prompt passes through, modeled as an explorable 3D machine. 21 stages, a 21-step guided journey tracing one token from "The cat sat on the" to "mat", real parameter counts from GPT-3 to DeepSeek-V3, and the training story — pretraining, RLHF, and the reasoning-RL breakthrough.

LLM Transformers Attention Mixture of Experts Reasoning Models 3D Interactive AI Explainer

All Guides