Core ML Concepts · intermediate · concept 42 of 311 · Updated Nov 4, 2026
Curriculum Learning
Training a model on easier examples first and harder ones later, like a school syllabus. Bengio and colleagues named the idea in 2009 and showed that a staged order speeds training and improves generalization. The hard part is deciding what counts as easy; self-paced and automatic curricula let the learner's own loss decide. OpenAI's robot hand learned to solve a Rubik's cube by widening its simulator's randomization only as it succeeded.
Top AI contributors on this
- Geoffrey HintonUniversity of Toronto (emeritus)
- Yoshua BengioLawZero / Université de Montréal
- Yann LeCunAMI Labs / NYU
- Andrew NgDeepLearning.AI / AI Fund
- Ilya SutskeverSafe Superintelligence Inc. (SSI)
- Andrej KarpathyAnthropic
Key terms
Where you meet it in the real world
Staged data mixes in LLM pretraining, robot manipulation in simulation, game-playing agents, machine translation with sentence-length ordering
Videos
Connor Shorten · YouTube
Flowers INRIA · YouTube
Continual Reinforcement Learning · YouTube
Guides and articles
Courses, papers, and more