5

memorisable information, being able to, for exam-
ple, perform on par with knowledge-bases (Petroni
et al., 2019). These observations, coupled with the
recognition that the formal linguistic competencies
and the ability of models to perform above the ran-
dom baseline on memorisable tasks do not pose
the risk of latent hazardous abilities, thereby ensur-
ing their safety, leads us to differentiate tasks that
hinge on formal linguistic abilities and memory
from functional linguistic abilities which demand
more advanced processes, such as reasoning.
AreEmergentAbilitiesinLarge Language Models just In-Context