Generating more answers for mathematical questions with LLMs is straightforward, but creating
questions is more challenging. The questions in GSM8K and MATH are written by well-educated
teachers. Hence, enlarging the question set through manual creation is time-consuming and labor-
intensive. To address this issue, we propose rephrasing prompting to generate more questions through
the LLM. Specifically, for a question qi, we append it to the prompt, which is then fed to the LLM
for generating the rephrased question. Example 3.1 shows a generated rephrased question and the
complete prompt is shown in Appendix A.1. We adopt temperature sampling to sample Krephrase
rephrased questions for each meta-question. For the rephrased questions, it is time-consuming to
manually check the consistency compared with the original questions. We propose a supervised
method to evaluate the correctness between the rephrased questions and the meta-questions. For
each rephrased question ˆq(j)
METAMATH