CCS Concepts: • Mathematics of computing; • Computer systems organization; • Software and its engineering; • Theory of
computation; • Applied computing;

Additional Key Words and Phrases: Large Language Models, Artificial Intelligence, Computational Efficiency, Memory Efficiency, Data
Utilization, Architecture Design, Training, Tuning, Inference, Software.
TheEfficiencySpectrumofLargeLanguageModels-AnAlgorithmicSurvey