0

100

75

50

25

0

100

75

50

25

0

1 2 4 6 8

1 2 4 6 8

1 2 4 6 8

1 2 4 6 8

1

2

3

4

Number of few-shot exemplars

Figure 11: The improvement of chain of thought prompting over standard prompting appears robust
to varying the number of few-shot exemplars in the prompt.

Table 12: Summary of math word problem benchmarks we use in this paper with examples. N:
number of evaluation examples.
Dataset
GSM8K

1,319 Josh decides to try ﬂipping a house. He buys a house for $80,000 and then puts
in $50,000 in repairs. This increased the value of the house by 150%. How
much proﬁt did he make?

N Example problem

SVAMP

1,000 Each pack of dvds costs 76 dollars. If there is a discount of 25 dollars on each

pack. How much do you have to pay to buy each pack?

2,096 Ellen has six more balls than Marin. Marin has nine balls. How many balls does

Ellen have?

ASDiv

AQuA
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models