Encyclopedia · 311 concepts
Learn this concept as a feed

Reinforcement Learning · advanced · concept 192 of 311 · Updated Nov 4, 2026

AlphaZero and MuZero

AlphaZero (2017) learns chess, shogi and Go from the rules alone, by self-play plus Monte Carlo tree search guided by one network that outputs a move policy and a position value. MuZero (2019) drops the rules too: it learns a model of the game's dynamics in a latent space and plans with that, matching AlphaZero on board games and setting a new state of the art on 57 Atari games. MuZero was later applied to video compression at YouTube.

Top AI contributors on this

Key terms

Self-playMonte Carlo tree search (MCTS)Policy and value headsLearned dynamics modelLatent statePlanning

Where you meet it in the real world

Chess and Go engines, video compression (YouTube), chip design and scheduling research, planning in simulators, game AI