Browse Teach Curate

LSTM Input Gate

A sigmoid gate that decides how much of the tanh-squashed candidate update is added into the cell state at each step. Gating the write separately from the erase lets the cell store new information without disturbing unrelated memory dimensions.

jeremy Video

LSTM Architecture Explained: Forget Gate, Input Gate and Output Gates in NLP

The Long Short-Term Memory (LSTM) network addresses the vanishing gradient problem in recurrent neural networks by introducing a dedicated long-term memory pathway called the cell state, which flows …