Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality
Paper
•
2405.21060
•
Published
•
68
Albert Gu
albertgu
AI & ML interests
None yet
Recent Activity
upvoted
an
article
about 2 months ago
A failed experiment: Infini-Attention, and why we should keep trying?
published
an
article
7 months ago
Bamba: Inference-Efficient Hybrid Mamba2 Model
liked
a Space
11 months ago
HuggingFaceFW/blogpost-fineweb-v1
Organizations
authored
a
paper
about 1 year ago
authored
3
papers
over 1 year ago
Caduceus: Bi-Directional Equivariant Long-Range DNA Sequence Modeling
Paper
•
2403.03234
•
Published
•
15
Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models
Paper
•
2402.19427
•
Published
•
57
Mamba: Linear-Time Sequence Modeling with Selective State Spaces
Paper
•
2312.00752
•
Published
•
143