A.4 How many examples were used as part of the CoT mixture in ﬁnetuning?
There are a total of 74,730 examples in the CoT mixture. Here are the number of training examples per dataset:
AQuA (2,715), CREAK (6,910), ECQA (7,110), ESNLI (36,170), GSM8K (7,470), QASC (1,080), QED (5,145),
Sensemaking (6,070), StrategyQA (2,060).

24

B Qualitative examples

See Figure 10 and Figure 11 for cherry-picked examples of responses to challenging instructions.

Figure 10: Qualitative examples of responses to challenging open-ended questions.

25
Scaling Instruction-Finetuned Language Models