Mamba is a completely new state House model architecture showing promising efficiency on details-dense data including language modeling, exactly where prior subquadratic models tumble in need of Transformers.
It begins https://k2spiceshop.com/product/liquid-k2-on-paper-online/