Processing Symposium (IPDPS). IEEE, 222–232.

[297] Yuanzhong Xu, HyoukJoong Lee, Dehao Chen, Blake Hechtman, Yanping Huang, Rahul Joshi, Maxim Krikun, Dmitry Lepikhin, Andy Ly, Marcello

Maggioni, et al. 2021. GSPMD: general and scalable parallelization for ML computation graphs. arXiv preprint arXiv:2105.04663 (2021).

34

The Efficiency Spectrum of Large Language Models: An Algorithmic Survey

Efficient LLM Algorithmic Survey, Nov, 2023, USA.

[298] Ziyun Xu, Chengyu Wang, Minghui Qiu, Fuli Luo, Runxin Xu, Songfang Huang, and Jun Huang. 2023. Making pre-trained language models end-to-end
few-shot learners with contrastive prompt tuning. In Proceedings of the Sixteenth ACM International Conference on Web Search and Data Mining. 438–446.
[299] Zhao Xu, Kai Yu, Volker Tresp, Xiaowei Xu, and Jizhi Wang. 2003. Representative sampling for text classification using support vector machines. In ECIR.

393–407.
TheEfficiencySpectrumofLargeLanguageModels-AnAlgorithmicSurvey