Mamba-Shedder: Post-Transformer Compression for Efficient Selective Structured State Space Models
Paper
•
2501.17088
•
Published
•
2
Mamba-Shedder
Compressed Mamba Models via Mamba-Shedder (Mamba-Shedder: Post-Transformer Compression for Efficient Selective Structured State Space Models)
-
IntelLabs/Mamba-Shedder-Mamba-2.2B
2B • Updated • 109 • 3Note Compressed Mamba-2.8B
-
IntelLabs/Mamba-Shedder-Mamba2-2.7B-Pruned-22SSM
3B • Updated • 109 • 2
IntelLabs/Mamba-Shedder-Mamba2-2.7B-Pruned-22SSM-Alpaca
3B • Updated • 110 • 2Note Compressed Mamba2-2.7B