Architectures · intermediate · concept 60 of 176

🏗️Residual Connections & ResNet

A shortcut that adds a layer's input to its output, letting gradients flow through very deep networks instead of vanishing. ResNet used it to jump from 20-layer to 150-layer networks in 2015, and every transformer block since is built around the same skip connection.