Math & Optimization · beginner · concept 36 of 176

📐Activation Functions

Non-linear functions applied to neuron outputs, they give neural networks the ability to learn complex patterns. ReLU, Sigmoid, Tanh, GELU, and Swish are the most common.