Advances in neural information processing systems 32 (2019).

[179] Xuezhe Ma, Chunting Zhou, Xiang Kong, Junxian He, Liangke Gui, Graham Neubig, Jonathan May, and Luke Zettlemoyer. 2023. Mega: moving average

[180] Seiji Maekawa, Dan Zhang, Hannah Kim, Sajjadur Rahman, and Estevam Hruschka. 2022. Low-resource interactive active labeling for fine-tuning language

[181] Katerina Margatina, Giorgos Vernikos, Loïc Barrault, and Nikolaos Aletras. 2021. Active learning by acquiring contrastive examples. arXiv preprint

equipped gated attention. ICLR (2023).

models. In Findings of EMNLP. 3230–3242.

arXiv:2109.03764 (2021).

30

The Efficiency Spectrum of Large Language Models: An Algorithmic Survey

Efficient LLM Algorithmic Survey, Nov, 2023, USA.
TheEfficiencySpectrumofLargeLanguageModels-AnAlgorithmicSurvey