10 + 97 = 107
17 + 82 = 99
21 + 68 = 89
35 + 29 = 64
75 + 68 = 143
10 + 28 = 38
48 + 60 = 108
88 + 46 = 134
83 + 49 = 132
11 + 62 = 73
25 + 24 =

18

C RESULTS WITH THE 300M BYT5 MODEL

The 300M model began self training after 8 digits. The training run is described in Figure 11. Its
last saved checkpoint was after successfully learning up to 24 digit addition problems, having failed
to successfully learn continue the training loop with 25 digit addition. Figures 7 and 8 describe the
generalization accuracies of the 300M parameter model over the course of training. Table 3 reports
the addition accuracies achieved by the final version of the model. Note that even though the model
was unable to continue training on the 25-digit iteration of learning, its previous checkpoint is still
able to do addition problems larger than 24 digits with reasonable accuracy.

Length

Accuracy (%)

1-19
98-100

20
95

21
98

22
98

23
99

24
98

25
91

26
33

27+
0
CHAIN-OF-THOUGHTREASONING IS APOLICY IMPROVEMENTOPERATOR