title: GPT Can Solve Mathematical Problems Without a Calculator
summary: Previous studies have typically assumed that large language models are unable
  to accurately perform arithmetic operations, particularly multiplication of >8
  digits, and operations involving decimals and fractions, without the use of
  calculator tools. This paper aims to challenge this misconception. With
  sufficient training data, a 2 billion-parameter language model can accurately
  perform multi-digit arithmetic operations with almost 100% accuracy without
  data leakage, significantly surpassing GPT-4 (whose multi-digit multiplication
  accuracy is only 4.3%). We also demonstrate that our MathGLM, fine-tuned from
  GLM-10B on a dataset with additional multi-step arithmetic operations and math
  problems described in text, achieves similar performance to GPT-4 on a
  5,000-samples Chinese math problem test set.
paper_authors._id: 64fa724fbb362cbf2fd19bd9
paper_authors.name: Zhen Yang
paper_authors._id: 64fa724fbb362cbf2fd19bda
paper_authors.name: Ming Ding
paper_authors._id: 64fa724fbb362cbf2fd19bdb
paper_authors.name: Qingsong Lv
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2023-09-08T11:33:38.507Z
paper_authors._id: 61bd8ac694bd578f7286181b
paper_authors.avatarUrl: /avatars/ff14b64339217858927ae01c2b2fa28d.svg
paper_authors.fullname: Qingsong Lv
paper_authors.type: user
paper_authors.user: qingsonglv
paper_authors._id: 64fa724fbb362cbf2fd19bdc
paper_authors.name: Zhihuan Jiang
paper_authors._id: 64fa724fbb362cbf2fd19bdd
paper_authors.name: Zehai He
paper_authors._id: 64fa724fbb362cbf2fd19bde
paper_authors.name: Yuyi Guo
paper_authors._id: 64fa724fbb362cbf2fd19bdf
paper_authors.name: Jinfeng Bai
paper_authors._id: 64fa724fbb362cbf2fd19be0
paper_authors.name: Jie Tang
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2023-09-08T11:34:59.355Z
paper_authors._id: 640dff05474aa6f89556677e
paper_authors.avatarUrl: /avatars/1b4591c7322d649c797b3125148f1915.svg
paper_authors.fullname: Jie Tang
paper_authors.type: user
paper_authors.user: jerytang
paper_title: GPT Can Solve Mathematical Problems Without a Calculator
paper_summary: Previous studies have typically assumed that large language models are unable
  to accurately perform arithmetic operations, particularly multiplication of >8
  digits, and operations involving decimals and fractions, without the use of
  calculator tools. This paper aims to challenge this misconception. With
  sufficient training data, a 2 billion-parameter language model can accurately
  perform multi-digit arithmetic operations with almost 100% accuracy without
  data leakage, significantly surpassing GPT-4 (whose multi-digit multiplication
  accuracy is only 4.3%). We also demonstrate that our MathGLM, fine-tuned from
  GLM-10B on a dataset with additional multi-step arithmetic operations and math
  problems described in text, achieves similar performance to GPT-4 on a
  5,000-samples Chinese math problem test set.
paper_ai_summary: A large language model with sufficient training data can accurately perform complex arithmetic operations without calculator tools, outperforming GPT-4.
paper_ai_keywords: large language models arithmetic operations multiplication decimals fractions training data 2 billion-parameter language model multi-digit arithmetic data leakage GPT-4 MathGLM GLM-10B multi-step arithmetic operations Chinese math problem test set