the model’s ability to follow instructions, and not
on in-context learning, possibly because, at this rel-
atively small scale, in-context learning is not strong
enough to manifest itself directly and does so only
through instruction tuning.

5.3 Comparative Analysis of Initial Tasks

Addressable via Instruction Tuning and
In-Context Learning
AreEmergentAbilitiesinLarge Language Models just In-Context