Extended LSTM with Exponential Gating and Matrix Memory

xLSTM architecture explaining exponential gating and memory mixing in recurrent neural networks

The xLSTM architecture introduces a theoretical framework for recurrent neural networks that resolves limitations in storage capacity and sequential processing via exponential gating mechanisms withi…