Figure 1 This plot shows task-specific Elo scores, indexed to a baseline model.

3

Elo scores for all three tasks are shown in Figure 1. Claude 2 improved over 1.3 on both helpfulness and
honesty, while scoring similarly to 1.3 on harmlessness. We’ve included the Helpful-Only 1.3 model in the
honesty and harmlessness tasks for comparison. That model was not trained with the interventions we use to
make Claude more honest and harmless, so the comparison helps us evaluate the effectiveness of our honesty
and harmlessness interventions.

3.2 BBQ Bias Evaluations
ClaudeModels