[62] Tri Dao, Daniel Y Fu, Khaled K Saab, Armin W Thomas, Atri Rudra, and Christopher Ré. 2022. Hungry hungry hippos: Towards language modeling with

NeurIPS 35 (2022), 16344–16359.

state space models. arXiv preprint arXiv:2212.14052 (2022).

[63] Tri Dao, Albert Gu, Matthew Eichhorn, Atri Rudra, and Christopher Ré. 2019. Learning fast algorithms for linear transforms using butterfly factorizations.

[64] Lieven De Lathauwer. 2008. Decompositions of a higher-order tensor in block terms—Part II: Definitions and uniqueness. SIAM J. Matrix Anal. Appl. 30, 3

[65] Tim Dettmers, Mike Lewis, Younes Belkada, and Luke Zettlemoyer. 2022. Gpt3. int8 (): 8-bit matrix multiplication for transformers at scale. NeurIPS 35

[66] Tim Dettmers, Artidoro Pagnoni, Ari Holtzman, and Luke Zettlemoyer. 2023. Qlora: Efficient finetuning of quantized llms. arXiv preprint arXiv:2305.14314

In ICML. PMLR, 1517–1527.

(2008), 1033–1066.

(2022), 30318–30332.

(2023).
TheEfficiencySpectrumofLargeLanguageModels-AnAlgorithmicSurvey