(2008), 137–213.

arXiv preprint arXiv:2105.14103 (2021).

Information Processing Systems 32 (2019).

arXiv preprint arXiv:2305.18403 (2023).

[322] Qingru Zhang, Minshuo Chen, Alexander Bukharin, Pengcheng He, Yu Cheng, Weizhu Chen, and Tuo Zhao. 2023. Adaptive budget allocation for

parameter-efficient fine-tuning. arXiv preprint arXiv:2303.10512 (2023).

[323] Shengyu Zhang, Linfeng Dong, Xiaoya Li, Sen Zhang, Xiaofei Sun, Shuhe Wang, Jiwei Li, Runyi Hu, Tianwei Zhang, Fei Wu, et al. 2023. Instruction Tuning

for Large Language Models: A Survey. arXiv preprint arXiv:2308.10792 (2023).

[324] Shujian Zhang, Chengyue Gong, Xingchao Liu, Pengcheng He, Weizhu Chen, and Mingyuan Zhou. 2022. Allsh: Active learning guided by local sensitivity

and hardness. arXiv preprint arXiv:2205.04980 (2022).

35

Efficient LLM Algorithmic Survey, Nov, 2023, USA.

Ding, Chen, et al.
TheEfficiencySpectrumofLargeLanguageModels-AnAlgorithmicSurvey