Encyclopedia · 187 concepts

Architectures · intermediate · concept 57 of 187

Recurrent Neural Network (RNN)

Architecture for sequential data that maintains a hidden state across time steps. Suffers from vanishing gradients for long sequences, largely replaced by Transformers but still relevant for understanding.

Key terms

Hidden stateVanishing gradientSequence-to-sequenceTime steps

Learn these first

Courses, papers, and more