that large RLHF models have gender biases that are very similar to language models evaluated at a lower
temperature.
Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback