title: Test-time Computing: from System-1 Thinking to System-2 Thinking
summary: The remarkable performance of the o1 model in complex reasoning demonstrates
  that test-time computing scaling can further unlock the model's potential,
  enabling powerful System-2 thinking. However, there is still a lack of
  comprehensive surveys for test-time computing scaling. We trace the concept of
  test-time computing back to System-1 models. In System-1 models, test-time
  computing addresses distribution shifts and improves robustness and
  generalization through parameter updating, input modification, representation
  editing, and output calibration. In System-2 models, it enhances the model's
  reasoning ability to solve complex problems through repeated sampling,
  self-correction, and tree search. We organize this survey according to the
  trend of System-1 to System-2 thinking, highlighting the key role of test-time
  computing in the transition from System-1 models to weak System-2 models, and
  then to strong System-2 models. We also point out a few possible future
  directions.
paper_authors._id: 677ca7db0c9718b04a426305
paper_authors.name: Yixin Ji
paper_authors.status: extracted_confirmed
paper_authors.statusLastChangedAt: 2025-01-07T04:53:11.414Z
paper_authors._id: 63412a43a7582111c3f1cadd
paper_authors.avatarUrl: /avatars/033e809a7aa3d9c4b1326e9195290f65.svg
paper_authors.fullname: Yixin Ji
paper_authors.type: user
paper_authors.user: Yisam
paper_authors._id: 677ca7db0c9718b04a426306
paper_authors.name: Juntao Li
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-01-07T09:51:35.155Z
paper_authors._id: 6670e285b0c03c4e9d6e0985
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/uCZHm4gKSHZ2b0hpHWgZv.jpeg
paper_authors.fullname: Juntao Li
paper_authors.type: user
paper_authors.user: douvleplus
paper_authors._id: 677ca7db0c9718b04a426307
paper_authors.name: Hai Ye
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2025-01-07T13:02:02.646Z
paper_authors._id: 6239888e7fef05b7bdd5fcff
paper_authors.avatarUrl: /avatars/54fcc756b8c0936b6bb410c6e0e02d75.svg
paper_authors.fullname: Hai Ye
paper_authors.type: user
paper_authors.user: oceanpty
paper_authors._id: 677ca7db0c9718b04a426308
paper_authors.name: Kaixin Wu
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2025-01-09T10:07:22.984Z
paper_authors._id: 677f1a2926d2ab07cfc7b37e
paper_authors.avatarUrl: /avatars/fca140098b3aa41b93107603b941f35f.svg
paper_authors.fullname: Wu Kaixin
paper_authors.type: user
paper_authors.user: daniel-wkx
paper_authors._id: 677ca7db0c9718b04a426309
paper_authors.name: Jia Xu
paper_authors._id: 677ca7db0c9718b04a42630a
paper_authors.name: Linjian Mo
paper_authors._id: 677ca7db0c9718b04a42630b
paper_authors.name: Min Zhang
paper_title: Test-time Computing: from System-1 Thinking to System-2 Thinking
paper_summary: The remarkable performance of the o1 model in complex reasoning demonstrates
  that test-time computing scaling can further unlock the model's potential,
  enabling powerful System-2 thinking. However, there is still a lack of
  comprehensive surveys for test-time computing scaling. We trace the concept of
  test-time computing back to System-1 models. In System-1 models, test-time
  computing addresses distribution shifts and improves robustness and
  generalization through parameter updating, input modification, representation
  editing, and output calibration. In System-2 models, it enhances the model's
  reasoning ability to solve complex problems through repeated sampling,
  self-correction, and tree search. We organize this survey according to the
  trend of System-1 to System-2 thinking, highlighting the key role of test-time
  computing in the transition from System-1 models to weak System-2 models, and
  then to strong System-2 models. We also point out a few possible future
  directions.
paper_ai_summary: Test-time computing scaling enhances complex reasoning in models, improving robustness, generalization, and problem-solving from System-1 to System-2 thinking through various mechanisms.
paper_ai_keywords: test-time computing System-1 models distribution shifts robustness generalization parameter updating input modification representation editing output calibration System-2 models repeated sampling self-correction tree search