Table 3 provides a description and an illustrative
example of three of the twenty two tasks utilised
in our experiments: one task demonstrating emer-
gence, one task that has not exhibited emergence,
and one task previously identified as emergent
solely in GPT-4 (GSM8K). A similar set of descrip-
tions and corresponding examples of all 22 of the
tasks that we use in our experiments is presented
in Appendix A, Table 8.

3.3 Controls for Possible Bias

So as to ensure that our evaluation is fair, we iden-
tify potential biases that could influence our find-
ings and design our experiments to mitigate such
biases. In cases where this is not possible, we shape
our experiments to maximise our chances of iden-
tifying such emergent abilities, if they do indeed
exist.

3.3.1 Prompt Formats
AreEmergentAbilitiesinLarge Language Models just In-Context