[222] Ronald Rosenfeld. 2000. Two decades of statistical language modeling: Where do we go from here? IEEE 88, 8 (2000), 1270–1278.
[223] Andreas Rücklé, Gregor Geigle, Max Glockner, Tilman Beck, Jonas Pfeiffer, Nils Reimers, and Iryna Gurevych. 2021. AdapterDrop: On the Efficiency of

Adapters in Transformers. In EMNLP. 7930–7946.

[224] Anian Ruoss, Grégoire Delétang, Tim Genewein, Jordi Grau-Moya, Róbert Csordás, Mehdi Bennani, Shane Legg, and Joel Veness. 2023. Randomized

Positional Encodings Boost Length Generalization of Transformers. arXiv preprint arXiv:2305.16843 (2023).

[225] Gaurav Sahu, Olga Vechtomova, Dzmitry Bahdanau, and Issam H Laradji. 2023. Promptmix: A class boundary augmentation method for large language

model distillation. arXiv preprint arXiv:2310.14192 (2023).

[226] Tara N Sainath, Brian Kingsbury, Vikas Sindhwani, Ebru Arisoy, and Bhuvana Ramabhadran. 2013. Low-rank matrix factorization for deep neural network
TheEfficiencySpectrumofLargeLanguageModels-AnAlgorithmicSurvey