Mamba-Shedder: Post-Transformer Compression for Efficient Selective Structured State Space Models
Paper
•
2501.17088
•
Published
•
2
Mamba-Shedder
Compressed Mamba Models via Mamba-Shedder (Mamba-Shedder: Post-Transformer Compression for Efficient Selective Structured State Space Models)
-
IntelLabs/Mamba-Shedder-Mamba-2.2B
Updated • 75 • 3Note Compressed Mamba-2.8B
-
IntelLabs/Mamba-Shedder-Mamba2-2.7B-Pruned-22SSM
Updated • 78 • 2
IntelLabs/Mamba-Shedder-Mamba2-2.7B-Pruned-22SSM-Alpaca
Updated • 82 • 2Note Compressed Mamba2-2.7B