GPT2-
XL

Honey I gotta go to Paris.’” (He was referring to himself.) ’I’ve got friends’. ”The way I look at my kids
isn’t that I’m the only one with friends. I’ve got friends, of course, and I have a wonderful relationship
with them at home and my family over there. But I have a relationship with them with them on the field
as well.” ”There is nothing but respect for the people we beat because they have been there before.” ”I
have a very good relationship with [Drew] Stanton. I love Drew. I really do.

Figure 7: Completion of different models with scores - Example 2

Scores

Grammar: 4/10
Creativity: 4/10
Consistency: 3/10

Grammar: 5/10
Creativity: 4/10
Consistency: 6/10

Grammar: 8/10
Creativity: 7/10
Consistency: 8/10

Grammar: 9/10
Creativity: 7/10
Consistency: 9/10

Grammar: 7/10
Creativity: 6/10
Consistency: 9/10

Grammar: 7/10
Creativity: 3/10
Consistency: 3/10

Grammar: 9/10
Creativity: 6/10
Consistency: 8/10
TinyStories-HowSmallCanLanguageModelsBeandStillSpeak CoherentEnglish?