4. A short summary (1-2 lines) of the story.

Every entry in this dataset has a random subset of the these instructions followed by the story itself. This way,
given a model trained on this dataset, we can compose a prompt to reflect any set of instructions and use the model
to generate a corresponding story. Here is an example from the dataset:

Summary: Lily and Timmy build a sandcastle together and learn to compromise, but it gets knocked over by a gust of wind.
They find beauty in the broken sandcastle and play happily with a butterfly.
Features: Dialogue, Foreshadowing, Twist
Sentence: One day, she went to the park and saw a beautiful butterfly.
Words: disagree, network, beautiful
Story: Once upon a time, there was a little girl named Lily. She loved to play with her toys and her friends. One day, she went

5Available on Huggingface under the name TinyStoriesInstruct.

4
TinyStories-HowSmallCanLanguageModelsBeandStillSpeak CoherentEnglish?