In order to give the reader an impression of the dependence of the quality of completions on the size of the
model, Figures 6, 7 and 8 each provide different completions for one prompt given by models of different sizes and
depths. Each table represents a different prompt, which we have manually composed8.

We see that the quality of generation clearly improves as a factor of size, and appears to be consistent with
the grades given by the GPT-4 evaluation. The smaller model (64 8) can barely produce a completion which looks
coherent with the beginning of the story, and often repeats itself or makes no sense. As the size increases, the
models become more and more coherent, and the grammar becomes better. The models can also generate more
diverse and creative endings, and use more details and emotions.
TinyStories-HowSmallCanLanguageModelsBeandStillSpeak CoherentEnglish?