Test Models. Our primary testing is conducted on GPT-3.5-Turbo, the model examined in Kim et al.
(2023); Shinn et al. (2023). Our goal is to reproduce the experiments described in the original papers.
However, the papers do not specify which version was used1. We opt for gpt-3.5-turbo-0613,
as we observed that the 0301 version almost always believes its initial response is correct, particu-
larly with the prompt in Kim et al. (2023). We also conduct tests on GPT-4, accessed on 2023/08/29,
aiming to test the self-correction capabilities of the latest and most powerful iteration of OpenAI’s
model. For GPT-3.5, we employ the full evaluation set mentioned earlier. For GPT-4, to reduce the
cost, we randomly sampled 200 questions for each dataset (100 for HotpotQA) for testing.

1The official implementation uses the continuously updated gpt-3.5-turbo kernel from OpenAI.

3

Large Language Models Cannot Self-Correct Reasoning Yet
LARGELANGUAGEMODELSCANNOTSELF-CORRECT REASONINGYET