Creativity (N = 20)
Context reasoning (N = 20)
Complex reasoning (N = 20)
Planning (N = 20)
Explanation (N = 20)
CoT: complex reasoning (N = 20)
CoT: planning (N = 20)
CoT: explanation (N = 20)
Few-shot (N = 30)

Figure 8: Percent preferred responses on a challenging set
of evaluations for open-ended generation, as evaluated by
human raters. Over all 190 evaluation examples, Flan-PaLM
generations were preferred over PaLM 79% of the time.

100

50

75

25

0

7 Discussion
Scaling Instruction-Finetuned Language Models