Hui Jiang. 2023. A latent space theory for emergent
abilities in large language models. arXiv preprint
arXiv:2304.09960.

Takeshi Kojima, Shixiang Shane Gu, Machel Reid, Yu-
taka Matsuo, and Yusuke Iwasawa. 2022. Large lan-
guage models are zero-shot reasoners. arXiv preprint
arXiv:2205.11916.

Michal Kosinski. 2023. Theory of mind may have spon-
taneously emerged in large language models. arXiv
preprint arXiv:2302.02083.

Yingcong Li, M. Emrullah Ildiz, Dimitris Papailiopou-
los, and Samet Oymak. 2023. Transformers as al-
gorithms: Generalization and stability in in-context
learning.

Yongjie Lin, Yi Chern Tan, and Robert Frank. 2019.
Open sesame: Getting inside BERT’s linguistic
knowledge. In Proceedings of the 2019 ACL Work-
shop BlackboxNLP: Analyzing and Interpreting Neu-
ral Networks for NLP, pages 241–253, Florence, Italy.
Association for Computational Linguistics.
AreEmergentAbilitiesinLarge Language Models just In-Context