setting” (Perez et al., 2021).

7Besides, numerous outputs fail (e.g., formatting issues) when applying Madaan et al. (2023)’s prompt,

necessitating many regenerations—another potential drawback of self-correction.

8

Large Language Models Cannot Self-Correct Reasoning Yet

or refine LLMs’ outputs. Indeed, in everyday usage scenarios, when interacting with LLMs, we
often provide feedback, guiding them to produce the content we desire. Utilizing this type of feed-
back, though not perpetually accessible, to assist LLMs in correcting their responses is intuitively
beneficial, particularly when the feedback is of high quality.
LARGELANGUAGEMODELSCANNOTSELF-CORRECT REASONINGYET