[20] Rae, J.W., Borgeaud, S., Cai, T., Millican, K., Hoﬀmann, J., Song, F., Aslanides,
J., Henderson, S., Ring, R., Young, S., et al.: Scaling language models: Meth-
ods, analysis & insights from training gopher. arXiv preprint arXiv:2112.11446
(2021)

[21] Hoﬀmann, J., Borgeaud, S., Mensch, A., Buchatskaya, E., Cai, T., Rutherford,
E., Casas, D.d.L., Hendricks, L.A., Welbl, J., Clark, A., et al.: Training compute-
optimal large language models. arXiv preprint arXiv:2203.15556 (2022)

[22] Anil, R., Dai, A.M., Firat, O., Johnson, M., Lepikhin, D., Passos, A., Shakeri, S.,
Taropa, E., Bailey, P., Chen, Z., et al.: Palm 2 technical report. arXiv preprint
arXiv:2305.10403 (2023)

[23] Gunantara, N.: A review of multi-objective optimization: Methods and its

applications. Cogent Engineering 5(1), 1502242 (2018)

[24] Menghani, G.: Eﬃcient deep learning: A survey on making deep learning models
smaller, faster, and better. ACM Computing Surveys (2021) https://doi.org/10.
1145/3578938
Beyond Efficiency