Cenk Baykal, Dylan Cutler, Nishanth Dikkala, Nikhil
Ghosh, Rina Panigrahy, and Xin Wang. 2023. Al-
ternating updates for efficient transformers. ArXiv,
abs/2301.13310.

Alexander Borzunov, Dmitry Baranchuk, Tim Dettmers,
Maksim Riabinin, Younes Belkada, Artem Chu-
machenko, Pavel Samygin, and Colin Raffel. 2023.
Petals: Collaborative inference and fine-tuning of
In Proceedings of the 61st Annual
large models.
Meeting of the Association for Computational Lin-
guistics (Volume 3: System Demonstrations), pages
558–568, Toronto, Canada. Association for Compu-
tational Linguistics.

Tom Brown, Benjamin Mann, Nick Ryder, Melanie
Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind

10

Neelakantan, Pranav Shyam, Girish Sastry, Amanda
Askell, et al. 2020. Language models are few-shot
learners. Advances in neural information processing
systems, 33:1877–1901.
LLM in a flash