we are still likely under-optimized on helpfulness. Dashed lines represent the asymptotic mean of the train
scores, to guide the eye in connecting the left and right panels.
Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback