9

AP Calculus
AP Chemistry
AP Physics
AMC10/12
Aggregate

ORM PRM Majority Vote # Problems
68.9% 86.7%
68.9% 80.0%
77.8% 86.7%
49.1% 53.2%
63.8% 72.9%

80.0%
71.7%
82.2%
32.8%
61.3%

45
60
45
84
234

Table 1: We measure out-of-distribution generalization using recent STEM tests.
We evaluate the outcome-supervised RM, the process-supervised RM, and ma-
jority voting using 100 test samples per problem.

relative lack of diversity limits the possible upside from active learning.
Let’s Verify Step by Step