Autoformalization of Game Descriptions using Large Language Models
<|reference_start|>Autoformalization of Game Descriptions using Large Language Models: Game theory is a powerful framework for reasoning about strategic interactions, with applications in domains ranging from day-to-day life to international politics. However, applying formal reasoning tools in such contexts is challenging, as these scenarios are often expressed in natural language. To address this, we introduce a framework for the autoformalization of game-theoretic scenarios, which translates natural language descriptions into formal logic representations suitable for formal solvers. Our approach utilizes one-shot prompting and a solver that provides feedback on syntactic correctness to allow LLMs to refine the code. We evaluate the framework using GPT-4o and a dataset of natural language problem descriptions, achieving 98% syntactic correctness and 88% semantic correctness. These results show the potential of LLMs to bridge the gap between real-life strategic interactions and formal reasoning.<|reference_end|>
@article{mensfelt2024autoformalization,
    title={Autoformalization of Game Descriptions using Large Language Models},
    author={Agnieszka Mensfelt and Kostas Stathis and Vince Trencsenyi},
    journal={arXiv preprint arXiv:2409.12300},
    year={2024},
    number={NeLaMKRR/2024/08},
    archivePrefix={arXiv},
    eprint={2409.12300},
    primaryClass={cs.AI cs.GT}
}