-

Method

Prior Best
UL2-20B∗
LaMDA-137B∗
PaLM-540B∗

Manual-CoT
Auto-CoT

Manual-CoT
Auto-CoT

Manual-CoT
Random-CoT
Auto-CoT
Iter-CoT(W)
Iter-CoT(S)

GSM8K AQuA AddSub
77.7γ
55.0α
18.2
4.4
51.9
14.3
56.9
91.9

37.9β
23.6
20.6
35.8

46.9
47.9

63.1
62.8

69.3
67.3
71.4
73.6
72.9

35.8
36.5

45.3

-

47.2
43.7
46.8
49.2
52.0

-
-

-
-

86.5
84.0
88.8
89.1
85.3

32.5δ
20.2
58.7
92.3

87.0

-

-
-

88.9
87.7
92.5
91.9
92.9

text-davinci-002

code-davinci-002

68.9
69.5

76.4

-

ChatGPT
77.2
77.4
77.6
80.7
80.1

-

-

-

71.3

80.4

82.5
80.1

82.8
83.0

-
0.0
13.5
63.0

56.6
59.7

70.4

-

72.2
68.0
76.0
88.8
78.4

73.5
74.4

77.9

-

77.1
77.3
72.5
76.8
78.0

65.4
65.4

73.2

-

71.1
65.3
63.4
69.3

-

-
-

-
-

-

78.6
67.4

80.0
74.7

-
-

-
-

-

-

40.3

67.8
49.8
Enhancing Chain-of-Thoughts Prompting with Iterative Bootstrapping in Large Language Models