Encyclopedia · 187 concepts
187 concepts explained · 10 categories · free
The AI Encyclopedia
Every concept on its own page: a plain-words definition, prerequisites you can follow backward, what it unlocks, key terms, curated free resources, and, where one exists, an interactive 3D machine or a full deep-dive read. Start anywhere; Previous and Next walk the whole encyclopedia in learning order.
New to all of this? Begin with Artificial Intelligence and just keep pressing Next. Every definition and link was reviewed in the July and August 2026 passes; videos and 3D builds attach to their concepts as they ship.
Core ML Concepts
34 concepts
Artificial Intelligence (AI)deep divebeg
Machine Learning (ML)deep divebeg
Supervised Learningdeep divebeg
Unsupervised Learningdeep divebeg
Neural Network3Dbeg
Deep Learningdeep divebeg
Features & Labelsbeg
Overfitting & Underfittingdeep divebeg
Classification vs Regressionbeg
Training vs Inferencebeg
Linear Regressionbeg
Data · The Fuel of AIbeg
Decision Trees & Random Forestsbeg
Evaluation Metrics & Cross-Validationbeg
Symbolic AI & Expert Systemsbeg
Logistic Regressionbeg
Exploratory Data Analysis (EDA)beg
k-Nearest Neighbors (kNN)beg
Naive Bayesbeg
Data Science vs ML vs AIbeg
Narrow AI vs Strong AIbeg
Bias-Variance Tradeoffint
Transfer Learningint
Regularizationint
Few-Shot & Zero-Shot Learningint
Semi-Supervised Learningint
Time Series Forecastingint
Support Vector Machines (SVM)int
Data Leakageint
Data Augmentationint
Self-Supervised Learningadv
Continual Learning & Catastrophic Forgettingadv
Meta-Learning (Learning to Learn)adv
Causal Inference & MLadv
Math & Optimization
18 concepts
Gradient Descent3Dbeg
Loss Function3Dbeg
Activation Functionsbeg
K-Means Clusteringbeg
Linear Algebra for MLbeg
Probability & Bayes' Theorembeg
Backpropagation3Dint
Embeddings3Dint
Dimensionality Reductionint
Feature Engineeringint
Anomaly Detectionint
Boosting (XGBoost, LightGBM)int
Information Theory: Entropy & KL Divergenceint
Optimizers: SGD, Momentum & Adamint
Evolutionary & Swarm Optimizationint
Bayesian ML & Uncertaintyadv
Monte Carlo Methodsadv
Probabilistic Graphical Models & HMMsadv
Architectures
21 concepts
Transformer Architecture3Dint
Attention Mechanism3Dint
Self-Attentionint
Convolutional Neural Network (CNN)int
Recurrent Neural Network (RNN)int
LSTM (Long Short-Term Memory)int
GPT (Generative Pre-trained Transformer)int
BERT (Bidirectional Encoder)int
Residual Connections & ResNetint
Normalization Layers (BatchNorm to RMSNorm)int
Autoencodersint
State Space Models (Mamba)adv
Vision Transformer (ViT)adv
Multimodal Modelsadv
Knowledge Distillationadv
Model Quantization & Compressionadv
Neural Architecture Search (NAS)adv
Neuro-Symbolic AIadv
Mixture-of-Experts (MoE)adv
Graph Neural Networks (GNNs)adv
Positional Encoding & RoPEadv
NLP & Language
26 concepts
Natural Language Processing (NLP)beg
Tokenization3Dbeg
Prompt Engineeringbeg
Sentiment Analysisbeg
Bag-of-Words & TF-IDFbeg
Large Language Models (LLMs)3Dbeg
Word2Vec & Word Embeddingsint
Retrieval-Augmented Generation (RAG)3Dint
Chain-of-Thought Reasoningint
Vector Databasesint
Context Window & Long Contextint
Text Generation & Samplingint
Machine Translationint
Named Entity Recognition (NER)int
Reasoning Models & Test-Time Computeint
Context Engineeringint
Speech Recognition (ASR) & Whisperint
LoRA & Parameter-Efficient Fine-Tuningint
Open-Weights & Small Language Modelsint
Text Summarizationint
Topic Modelingint
Information Extractionint
Fine-Tuning LLMsadv
LLM Scaling Lawsadv
RLHF (Reinforcement Learning from Human Feedback)adv
DPO & Preference Optimizationadv
Computer Vision
10 concepts
Generative AI
12 concepts
Synthetic Dataint
Stable Diffusion & Text-to-Imageint
Voice Cloning & TTSint
AI Music Generationint
AI Code Generationint
AI Image Editing & Inpaintingint
Diffusion Modelsadv
GANs (Generative Adversarial Networks)adv
VAEs (Variational Autoencoders)adv
Text-to-Video Generationadv
3D Generation & NeRFsadv
Flow Matching & Modern Diffusionadv
Reinforcement Learning
11 concepts
Reinforcement Learning (RL)deep diveint
Q-Learning & Deep Q-Networks (DQN)int
Markov Decision Process (MDP)int
Policy Gradient & Actor-Criticadv
PPO (Proximal Policy Optimization)adv
Reward Design & Reward Hackingadv
Multi-Agent Reinforcement Learningadv
World Modelsadv
Sim-to-Real Transferadv
Inverse Reinforcement Learningadv
GRPO (Group Relative Policy Optimization)adv
MLOps & Infrastructure
20 concepts
GPU & TPU Computingbeg
Experiment Trackingbeg
The AI Stackbeg
ML Frameworks (PyTorch, TensorFlow, JAX)beg
AI Platformsbeg
Model Deployment & Servingint
MLOps (ML Operations)int
Data Pipelines & ETLint
Edge AI & On-Device MLint
Model Versioning & Registryint
ML Monitoring & Observabilityint
LLM Evaluation & Benchmarksint
Hyperparameter Tuningint
AI Data Centers & the AI Factoryint
Inference Cost & Token Economicsint
Federated Learningadv
Distributed Trainingadv
Inference Optimizationadv
Quantum Machine Learningadv
Numerical Precision & Mixed-Precision Trainingadv
AI Agents & Applications
20 concepts
AI for Creative Industriesbeg
Enterprise AIbeg
Vibe Codingbeg
AI Agentsint
Tool Use & Function Callingint
Recommendation Systemsint
Explainable AI (XAI)int
AI-Powered Search & Rankingint
Conversational AI & Chatbotsint
Model Context Protocol (MCP)int
Computer Use & Browser Agentsint
Agentic Codingint
Multi-Agent Systems & Orchestrationint
Autonomous Vehicles & Roboticsadv
AI-Driven Drug Discoveryadv
AI in Healthcare & Medical Imagingadv
Vision-Language-Action Modelsadv
Agent Memory, Planning & Reflectionadv
Agent Harnesses & Scaffoldingadv
Agent-to-Agent Protocols (A2A)adv
Safety, Ethics & Governance
15 concepts
AI Hallucinationsdeep divebeg
AI Regulation & Governancebeg
AI Safetybeg
Responsible AIbeg
AI Alignmentint
AI Bias & Fairnessint
Red Teaming AI Systemsint
Prompt Injection & Jailbreakingint
AI Watermarking & Content Detectionint
AGI (Artificial General Intelligence)deep diveint
Superintelligence (ASI)int
Technological Singularityint
Mechanistic Interpretabilityadv
Constitutional AI & RLAIFadv
Differential Privacy & ML Privacyadv