Letter Concat: 2

Letter Concat: 4

(in domain)

(OOD)

Coin Flip: 2
(in domain)

Coin Flip: 4

(OOD)

5 Symbolic Reasoning

Our ﬁnal experimental evaluation considers symbolic rea-
soning, which is simple for humans but potentially chal-
lenging for language models. We show that chain-of-
thought prompting not only enables language models to
perform symbolic reasoning tasks that are challenging in
the standard prompting setting, but also facilitates length
generalization to inference-time inputs longer than those
seen in the few-shot exemplars.
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models