Llm, Llm Reasoning, Maths Reasoning Llm, Data Augmentation Llm, AI.
The researchers found that RFT improves the mathematical reasoning performance of LLMs, especially for less performant models. They also found that combining rejection samples from multiple models further enhances the RFT performance. However, they noted that the benefits of RFT diminish as the