About mamba paper

One way of incorporating a range mechanism into products is by allowing their parameters that impact interactions along the sequence be input-dependent. Operating on byte-sized tokens, transformers scale badly as each and every token have to "go to" to each other token bringing about O(n2

read more