Table 19: The exemplars are selected on CSQA train set.

29

DATASET

Iter-CoT(S) Exemplars

Date Understading Q: This is the last day of 1899. What is the date today in MM/DD/YYYY? Choices: A.09/26/1899 B.12/31/1899

C.11/30/1899 D.01/09/1900 E.12/22/1899 F.12/31/1885
A: Reasoning process: 1. The year is 1899 because it is the last day of the year. 2. The month is December because it is
the last day of the month. 3. The date is 31 because it is the last day of the month. Final answer: B.
Enhancing Chain-of-Thoughts Prompting with Iterative Bootstrapping in Large Language Models