comprehension and utilisation (this distinction is
further discussed in Section 2). However, while
PLMs appeared to excel in formal linguistic abili-
ties, they have until recently faced challenges in de-
veloping functional linguistic abilities (Mahowald
et al., 2023) (see also Section 2).
AreEmergentAbilitiesinLarge Language Models just In-Context