MiroMind-M1: An Open-Source Advancement in Mathematical Reasoning via
  Context-Aware Multi-Stage Policy Optimization
Large language models have recently evolved from fluent text generation to
advanced reasoning across diverse domains, giving rise to reasoning language
models. Among these domains, mathematical reasoning serves as a representative
benchmark as it requires precise multi-step logic and abstract reasoning, which
can be generalized to other tasks. While closed-source RLMs such as GPT-o3
demonstrate impressive reasoning capabilities, their proprietary nature limits
transparency and reproducibility. Although many open-source projects aim to
close this gap, most of them lack sufficient openness by omitting critical
resources such as datasets and detailed training configurations, which hinders
reproducibility. To contribute toward greater transparency in RLM development,
we introduce the MiroMind-M1 series, a set of fully open-source RLMs built on
the Qwen-2.5 backbone that match or exceed the performance of existing
open-source RLMs. Specifically, our models are trained in two stages: SFT on a
carefully curated corpus of 719K math-reasoning problems with verified CoT
trajectories, followed by RLVR on 62K challenging and verifiable problems. To
enhance the robustness and efficiency of the RLVR process, we introduce
Context-Aware Multi-Stage Policy Optimization, an algorithm that integrates
length-progressive training with an adaptive repetition penalty to encourage
context-aware RL training. Our model achieves state-of-the-art or competitive
performance and superior token efficiency among Qwen-2.5-based open-source 7B
and 32B models on the AIME24, AIME25, and MATH benchmarks. To facilitate
reproducibility, we release the complete stack: models (MiroMind-M1-SFT-7B,
MiroMind-M1-RL-7B, MiroMind-M1-RL-32B); datasets (MiroMind-M1-SFT-719K,
MiroMind-M1-RL-62K); and all training and evaluation configurations. We hope
these resources will support further research and foster community advancement.
687eece833947f780d9b4a56
Xingxuan Li
claimed_verified
2025-07-22T07:57:41.590Z
6362a77dd3be91534c2e9213
https://cdn-avatars.huggingface.co/v1/production/uploads/6362a77dd3be91534c2e9213/3uUM3B1m2CFMukbkA0yDv.png
Xingxuan Li
user
veggiebird
687eece833947f780d9b4a57
Yao Xiao
687eece833947f780d9b4a58
Dianwen Ng
687eece833947f780d9b4a59
Hai Ye
687eece833947f780d9b4a5a
Yue Deng
687eece833947f780d9b4a5b
Xiang Lin
687eece833947f780d9b4a5c
Bin Wang
claimed_verified
2025-07-22T07:54:16.103Z
5e49e8cf37cb5b49818287ae
https://cdn-avatars.huggingface.co/v1/production/uploads/5e49e8cf37cb5b49818287ae/IV9b5Z70NhgmBNfAlc_co.jpeg
Bin Wang
user
binwang
687eece833947f780d9b4a5d
Zhanfeng Mo
687eece833947f780d9b4a5e
Chong Zhang
687eece833947f780d9b4a5f
Yueyi Zhang
687eece833947f780d9b4a60
Zonglin Yang
claimed_verified
2025-07-22T07:49:22.809Z
646a11791556443f24b582e9
/avatars/b54d416ddca2f124492ba51bc4b95fd2.svg
Zonglin Yang
user
ZonglinY
687eece833947f780d9b4a61
Ruilin Li
687eece833947f780d9b4a62
Lei Lei
687eece833947f780d9b4a63
Shihao Xu
687eece833947f780d9b4a64
Han Zhao
687eece833947f780d9b4a65
Weiling Chen
687eece833947f780d9b4a66
Feng Ji
687eece833947f780d9b4a67
Lidong Bing
claimed_verified
2025-07-22T07:49:24.709Z
6454685a548f22be598414c4
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/eMjMWKJ-AouF7eY1-RzGF.jpeg
Lidong Bing
user
LidongBing
MiroMind-M1: An Open-Source Advancement in Mathematical Reasoning via
  Context-Aware Multi-Stage Policy Optimization
Large language models have recently evolved from fluent text generation to
advanced reasoning across diverse domains, giving rise to reasoning language
models. Among these domains, mathematical reasoning serves as a representative
benchmark as it requires precise multi-step logic and abstract reasoning, which
can be generalized to other tasks. While closed-source RLMs such as GPT-o3
demonstrate impressive reasoning capabilities, their proprietary nature limits
transparency and reproducibility. Although many open-source projects aim to
close this gap, most of them lack sufficient openness by omitting critical
resources such as datasets and detailed training configurations, which hinders
reproducibility. To contribute toward greater transparency in RLM development,
we introduce the MiroMind-M1 series, a set of fully open-source RLMs built on
the Qwen-2.5 backbone that match or exceed the performance of existing
open-source RLMs. Specifically, our models are trained in two stages: SFT on a
carefully curated corpus of 719K math-reasoning problems with verified CoT
trajectories, followed by RLVR on 62K challenging and verifiable problems. To
enhance the robustness and efficiency of the RLVR process, we introduce
Context-Aware Multi-Stage Policy Optimization, an algorithm that integrates
length-progressive training with an adaptive repetition penalty to encourage
context-aware RL training. Our model achieves state-of-the-art or competitive
performance and superior token efficiency among Qwen-2.5-based open-source 7B
and 32B models on the AIME24, AIME25, and MATH benchmarks. To facilitate
reproducibility, we release the complete stack: models (MiroMind-M1-SFT-7B,
MiroMind-M1-RL-7B, MiroMind-M1-RL-32B); datasets (MiroMind-M1-SFT-719K,
MiroMind-M1-RL-62K); and all training and evaluation configurations. We hope
these resources will support further research and foster community advancement.
The MiroMind-M1 series, built on Qwen-2.5, introduces fully open-source reasoning language models with state-of-the-art performance in mathematical reasoning through Context-Aware Multi-Stage Policy Optimization.
reasoning language models mathematical reasoning GPT-o3 Qwen-2.5 SFT RLVR Context-Aware Multi-Stage Policy Optimization length-progressive training adaptive repetition penalty AIME24 AIME25 MATH benchmarks