16

Semantic understanding
(62B made 20 errors of this type, 540B ﬁxes 6 of them)One step missing
(62B made 18 errors of this type, 540B ﬁxes 12 of them)Other
(62B made 7 errors of this type, 540B ﬁxes 4 of them)Types of errors made by a 62B language model:Errors ﬁxed by scaling from 62B to 540BFigure 10: Examples of semantic understanding and one-step missing errors that were ﬁxed by
scaling PaLM from 62B to 540B.

A.2 What is the role of prompt engineering?
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models