[143] Vucetic, D., Tayaranian, M., Ziaeefard, M., Clark, J.J., Meyer, B.H., Gross,
W.J.: Eﬃcient ﬁne-tuning of compressed language models with learners. arXiv
preprint arXiv:2208.02070 (2022)

[144] Marjieh, R., Sucholutsky, I., Rijn, P., Jacoby, N., Griﬃths, T.L.: What lan-
guage reveals about perception: Distilling psychophysical knowledge from large
language models. arXiv preprint arXiv:2302.01308 (2023)

[145] Azerbayev, Z., Ni, A., Schoelkopf, H., Radev, D.: Explicit knowledge transfer
for weakly-supervised code generation. arXiv preprint arXiv:2211.16740 (2022)

[146] Gu, Y., Dong, L., Wei, F., Huang, M.: Knowledge distillation of large language

models. arXiv preprint arXiv:2306.08543 (2023)

[147] Zhang, R., Shen, J., Liu, T., Liu, J., Bendersky, M., Najork, M., Zhang, C.: Do
not blindly imitate the teacher: Using perturbed loss for knowledge distillation.
arXiv preprint arXiv:2305.05010 (2023)
Beyond Efficiency