5.4 Comparison of Instruction Following in
the absence of direct In-context Learning
Having examined the tasks that models can tackle
successfully (i.e., performing above baseline), we
proceed to compare the tasks that can be effectively
tackled by Flan-T5 with those by the different ver-
sions of GPT-3. It is important to note that GPT-3
has more than 200 times the number of parameters
present in T5, and no prior research has reported
indications of emergent abilities within either Flan-
AreEmergentAbilitiesinLarge Language Models just In-Context