it was trained on a different portion of data that neither the policy nor the train PM had observed.
We provide more discussion in Appendix B.2.
Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback