Conceptual

State-Space Models (Mamba)

Sub-quadratic sequence modeling: selective state-space layers with input-dependent dynamics, recurrent and convolutional views, and where SSMs replace or hybridize with attention.