Architectures · intermediate · concept 56 of 176
Recurrent Neural Network (RNN)
Architecture for sequential data that maintains a hidden state across time steps. Suffers from vanishing gradients for long sequences, largely replaced by Transformers but still relevant for understanding.
Key terms
Hidden stateVanishing gradientSequence-to-sequenceTime steps
Learn these first
Videos
▶ Recurrent Neural Networks (RNNs), Clearly Explained!!! ↗
StatQuest with Josh Starmer · YouTube
▶ The Power of Recurrent Neural Networks (RNN) ↗
IBM Technology · YouTube
Guides and articles
Courses, papers, and more
This unlocks