It is not clear whether supervision by PRMlarge or by final-answer checking
represents the more appropriate outcome supervision baseline. While final-
answer supervision is more explicitly outcome based, its main weakness — the
existence of false positives — is arguably over-emphasized in the MATH dataset.
Outcome supervision by PRMlarge better represents outcome supervision in do-
mains that are less susceptible to false positives. We consider outcome supervi-
sion by PRMlarge to be the more relevant baseline, but we encourage the reader
to draw their own conclusions.

4.2 Active Learning
Let’s Verify Step by Step