Architectures · intermediate · concept 57 of 176
LSTM (Long Short-Term Memory)
An RNN variant that solves the vanishing gradient problem using gates (forget, input, output) that control information flow. Was the dominant sequence architecture before Transformers.
Key terms
Forget gateInput gateOutput gateCell stateGRU
Learn these first
Videos
▶ Long Short-Term Memory (LSTM), Clearly Explained ↗
StatQuest with Josh Starmer · YouTube
▶ Recurrent Neural Networks (RNNs), Clearly Explained!!! ↗
StatQuest with Josh Starmer · YouTube
Guides and articles
Courses, papers, and more