CriticLean: Critic-Guided Reinforcement Learning for Mathematical
  Formalization
Translating natural language mathematical statements into formal, executable
code is a fundamental challenge in automated theorem proving. While prior work
has focused on generation and compilation success, little attention has been
paid to the critic phase-the evaluation of whether generated formalizations
truly capture the semantic intent of the original problem. In this paper, we
introduce CriticLean, a novel critic-guided reinforcement learning framework
that elevates the role of the critic from a passive validator to an active
learning component. Specifically, first, we propose the CriticLeanGPT, trained
via supervised fine-tuning and reinforcement learning, to rigorously assess the
semantic fidelity of Lean 4 formalizations. Then, we introduce CriticLeanBench,
a benchmark designed to measure models' ability to distinguish semantically
correct from incorrect formalizations, and demonstrate that our trained
CriticLeanGPT models can significantly outperform strong open- and
closed-source baselines. Building on the CriticLean framework, we construct
FineLeanCorpus, a dataset comprising over 285K problems that exhibits rich
domain diversity, broad difficulty coverage, and high correctness based on
human evaluation. Overall, our findings highlight that optimizing the critic
phase is essential for producing reliable formalizations, and we hope our
CriticLean will provide valuable insights for future advances in formal
mathematical reasoning.
686dcc36cb5725779c60b393
Zhongyuan Peng
claimed_verified
2025-07-09T14:41:00.582Z
63299f93688ad82b783aaf20
/avatars/7c11e60e551ef1c62aa2862529e357f5.svg
zhongyuan peng
user
happzy2633
686dcc36cb5725779c60b394
Yifan Yao
686dcc36cb5725779c60b395
Kaijing Ma
686dcc36cb5725779c60b396
Shuyue Guo
686dcc36cb5725779c60b397
Yizhe Li
686dcc36cb5725779c60b398
Yichi Zhang
686dcc36cb5725779c60b399
Chenchen Zhang
686dcc36cb5725779c60b39a
Yifan Zhang
claimed_verified
2025-07-09T08:50:21.463Z
647bf082aba7062fe5c51ca9
https://cdn-avatars.huggingface.co/v1/production/uploads/647bf082aba7062fe5c51ca9/p4lY9IjHiWZETKmFq1mtU.jpeg
Yifan Zhang
user
yifAI
686dcc36cb5725779c60b39b
Zhouliang Yu
claimed_verified
2025-07-09T08:50:19.408Z
62a80fe3ac97233f1625235a
https://cdn-avatars.huggingface.co/v1/production/uploads/62a80fe3ac97233f1625235a/_rGtpqdY7OEBz3pyqb6fE.jpeg
Zhouliang Yu
user
zhouliang
686dcc36cb5725779c60b39c
Luming Li
686dcc36cb5725779c60b39d
Minghao Liu
claimed_verified
2025-07-10T07:10:04.699Z
6417d9ea8f689506e7148417
https://cdn-avatars.huggingface.co/v1/production/uploads/6417d9ea8f689506e7148417/bAYcruWNw4WvmuQcGgcwC.jpeg
minghao
user
Liam-Liu
686dcc36cb5725779c60b39e
Yihang Xia
686dcc36cb5725779c60b39f
Jiawei Shen
686dcc36cb5725779c60b3a0
Yuchen Wu
686dcc36cb5725779c60b3a1
Yixin Cao
686dcc36cb5725779c60b3a2
Zhaoxiang Zhang
686dcc36cb5725779c60b3a3
Wenhao Huang
686dcc36cb5725779c60b3a4
Jiaheng Liu
686dcc36cb5725779c60b3a5
Ge Zhang
claimed_verified
2025-07-09T08:50:23.532Z
638efcf4c67af472d316d424
/avatars/97a57859d7d87a3a8f1bb41d32a72bc2.svg
Ge Zhang
user
zhangysk
CriticLean: Critic-Guided Reinforcement Learning for Mathematical
  Formalization
Translating natural language mathematical statements into formal, executable
code is a fundamental challenge in automated theorem proving. While prior work
has focused on generation and compilation success, little attention has been
paid to the critic phase-the evaluation of whether generated formalizations
truly capture the semantic intent of the original problem. In this paper, we
introduce CriticLean, a novel critic-guided reinforcement learning framework
that elevates the role of the critic from a passive validator to an active
learning component. Specifically, first, we propose the CriticLeanGPT, trained
via supervised fine-tuning and reinforcement learning, to rigorously assess the
semantic fidelity of Lean 4 formalizations. Then, we introduce CriticLeanBench,
a benchmark designed to measure models' ability to distinguish semantically
correct from incorrect formalizations, and demonstrate that our trained
CriticLeanGPT models can significantly outperform strong open- and
closed-source baselines. Building on the CriticLean framework, we construct
FineLeanCorpus, a dataset comprising over 285K problems that exhibits rich
domain diversity, broad difficulty coverage, and high correctness based on
human evaluation. Overall, our findings highlight that optimizing the critic
phase is essential for producing reliable formalizations, and we hope our
CriticLean will provide valuable insights for future advances in formal
mathematical reasoning.
CriticLean, a critic-guided reinforcement learning framework, enhances the evaluation of formalizations in automated theorem proving by actively learning and distinguishing semantically correct formalizations.
critic phase reinforcement learning CriticLean CriticLeanGPT supervised fine-tuning semantic fidelity Lean 4 formalizations CriticLeanBench FineLeanCorpus formal mathematical reasoning