RoMath: A Mathematical Reasoning Benchmark in Romanian
<|reference_start|>RoMath: A Mathematical Reasoning Benchmark in Romanian: Mathematics has long been conveyed through natural language, primarily for human understanding. With the rise of mechanized mathematics and proof assistants, there is a growing need to understand informal mathematical text, yet most existing benchmarks focus solely on English, overlooking other languages. This paper introduces RoMath, a Romanian mathematical reasoning benchmark suite comprising three datasets: RoMath-Baccalaureate, RoMath-Competitions and RoMath-Synthetic, which cover a range of mathematical domains and difficulty levels, aiming to improve non-English language models and promote multilingual AI development. By focusing on Romanian, a low-resource language with unique linguistic features, RoMath addresses the limitations of Anglo-centric models and emphasizes the need for dedicated resources beyond simple automatic translation. We benchmark several open-weight language models, highlighting the importance of creating resources for underrepresented languages. We make the code and dataset available.<|reference_end|>
@article{cosma2024romath:,
    title={RoMath: A Mathematical Reasoning Benchmark in Romanian},
    author={Adrian Cosma, Ana-Maria Bucur, Emilian Radoi},
    journal={arXiv preprint arXiv:2409.11074},
    year={2024},
    archivePrefix={arXiv},
    eprint={2409.11074},
    primaryClass={cs.CL cs.AI}
}