Efficient LLM Inference on CPUs
Paper
•
2311.00502
•
Published
•
7
cpu inference
-
-
Exponentially Faster Language Modelling
Paper • 2311.10770 • Published • 117 -
Cached Transformers: Improving Transformers with Differentiable Memory Cache
Paper • 2312.12742 • Published • 12 -
LLM in a flash: Efficient Large Language Model Inference with Limited Memory
Paper • 2312.11514 • Published • 257 -
Efficient LLM inference solution on Intel GPU
Paper • 2401.05391 • Published • 9 -
Specialized Language Models with Cheap Inference from Limited Domain Data
Paper • 2402.01093 • Published • 45 -
Fiddler: CPU-GPU Orchestration for Fast Inference of Mixture-of-Experts Models
Paper • 2402.07033 • Published • 16 -
GEB-1.3B: Open Lightweight Large Language Model
Paper • 2406.09900 • Published • 20