Encyclopedia · 176 concepts

Architectures · intermediate · concept 56 of 176

Recurrent Neural Network (RNN)

Architecture for sequential data that maintains a hidden state across time steps. Suffers from vanishing gradients for long sequences, largely replaced by Transformers but still relevant for understanding.

Key terms

Hidden stateVanishing gradientSequence-to-sequenceTime steps

Learn these first

Courses, papers, and more