SIMPLIFY-THEN-GUESS

Simplify-then-guess also has spiritual similarities to how AlphaZero often does not perform MCTS
to the end of the game, instead terminating search after a certain depth and returning the output of
the value network. The analogy for simplify-then-guess is that SECToR runs K steps of simplifi-
cation (i.e. search) before taking a guess at the answer (i.e. querying the value network) instead of
simplifying all the way to 1-digit addition (i.e. running MCTS to the end of the game). This takes
direct advantage of the inductive curriculum-style training in which a model learns to add 1 to N
digit numbers before being asked to generate training data for N + 1 addition numbers.

23

F ERROR ANALYSIS
CHAIN-OF-THOUGHTREASONING IS APOLICY IMPROVEMENTOPERATOR