(2022), a closer comparison reveals that they are not inconsistent. The majority of the successful zero-shot CoT
experiments in that paper in fact leverage InstructGPT (Ouyang et al., 2022), which was instruction-ﬁnetuned
(and we hypothesize that this instruction ﬁnetuning included some CoT-like data). Successful experiments
for zero-shot CoT on PaLM without ﬁnetuning were only shown for math word problems, which diﬀer
substantially from the types of problems in BBH.
Scaling Instruction-Finetuned Language Models