Llm, Llm Reasoning, Maths Reasoning Llm, Data Augmentation Llm, AI.
researchers in this paper focus on understanding how pre-training loss, the amount of supervised data, and the amount of augmented data influence the reasoning performances of a supervised LLM. They propose a new method called Rejection Sampling Fine-Tuning (RFT) to augment the training data and