MiniMax-01: Scaling Foundation Models with Lightning Attention
Paper
•
2501.08313
•
Published
•
295
LLM Architecture
-
-
Scalable-Softmax Is Superior for Attention
Paper • 2501.19399 • Published • 22 -
FastKV: KV Cache Compression for Fast Long-Context Processing with Token-Selective Propagation
Paper • 2502.01068 • Published • 17 -
Scaling Embedding Layers in Language Models
Paper • 2502.01637 • Published • 24 -
Taming the Titans: A Survey of Efficient LLM Inference Serving
Paper • 2504.19720 • Published • 11