Albert Gu

albertgu's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

upvoted an article 5 days ago

view article

Article

A failed experiment: Infini-Attention, and why we should keep trying?

By and 2 others •

Aug 14, 2024

• 64

published an article 6 months ago

view article

Article

Bamba: Inference-Efficient Hybrid Mamba2 Model

By and 28 others •

Dec 18, 2024

• 55

liked a Space 9 months ago

Running

960

960

FineWeb: decanting the web for the finest text data at scale

🍷

Generate high-quality web text data for LLM training

upvoted a paper about 1 year ago

Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality

Paper • 2405.21060 • Published May 31, 2024 • 68

authored a paper about 1 year ago

Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality

Paper • 2405.21060 • Published May 31, 2024 • 68

liked a model about 1 year ago

ai21labs/Jamba-v0.1

Text Generation • Updated Sep 11, 2024 • 2.97k • 1.18k

authored a paper about 1 year ago

Caduceus: Bi-Directional Equivariant Long-Range DNA Sequence Modeling

Paper • 2403.03234 • Published Mar 5, 2024 • 15

authored a paper over 1 year ago

Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models

Paper • 2402.19427 • Published Feb 29, 2024 • 57

upvoted a paper over 1 year ago

Mamba: Linear-Time Sequence Modeling with Selective State Spaces

Paper • 2312.00752 • Published Dec 1, 2023 • 143

authored a paper over 1 year ago

Mamba: Linear-Time Sequence Modeling with Selective State Spaces

Paper • 2312.00752 • Published Dec 1, 2023 • 143

updated a model about 2 years ago

krandiash/sashimi-release

Updated Mar 31, 2023 • 6