Reinforcement Learning · intermediate · concept 122 of 176
Q-Learning & Deep Q-Networks (DQN)
Q-Learning estimates the value of actions in each state. Deep Q-Networks (DQN) use neural networks to approximate Q-values, DeepMind's DQN played Atari games at superhuman level (2013). SARSA is Q-learning's on-policy sibling: it learns from the action actually taken rather than the greedy one.
Key terms
Q-valueBellman equationExperience replayTarget networkSARSA
Learn these first
Videos
▶ Large Language Models explained briefly ↗
3Blue1Brown · YouTube
Guides and articles
Introduction to Q-Learning · Hugging Face ↗
Hugging Face
Part 2: Kinds of RL Algorithms — Spinning Up documentation ↗
OpenAI Spinning Up
Courses, papers, and more
This unlocks