To remove confounders and bolster our conclusions, we perform additional controlled experiments
(Figure 16) holding dataset size and other hyperparameters ﬁxed.

1.2 Summary of Evaluations and Metrics
Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback