Cross-Language Assessment of Mathematical Capability of ChatGPT
<|reference_start|>Cross-Language Assessment of Mathematical Capability of ChatGPT: This paper presents an evaluation of the mathematical capability of ChatGPT across diverse languages like Hindi, Gujarati, and Marathi. ChatGPT, based on GPT-3.5 by OpenAI, has garnered significant attention for its natural language understanding and generation abilities. However, its performance in solving mathematical problems across multiple natural languages remains a comparatively unexplored area, especially in regional Indian languages. In this paper, we explore those capabilities as well as using chain-of-thought prompting to figure out if it increases the accuracy of responses as much as it does in the English language and provide insights into the current limitations.<|reference_end|>
@article{sathe2024cross-language,
    title={Cross-Language Assessment of Mathematical Capability of ChatGPT},
    author={Gargi Sathe, Aneesh Shamraj, Aditya Surve, Nahush Patil, Kumkum Saxena},
    journal={arXiv preprint arXiv:2405.11264},
    year={2024},
    archivePrefix={arXiv},
    eprint={2405.11264},
    primaryClass={cs.CL cs.LG}
}