Architectures · advanced · concept 64 of 187

🏗️State Space Models (Mamba)

An alternative to Transformers that processes sequences with linear-time complexity instead of quadratic attention. Mamba and S4 are the foundational SSM architectures, and hybrid attention-SSM designs now appear in production models, offering advantages for very long sequences.