Paper Review, Deep Learning, Rlhf, Llm, NLP.
Evaluators may Pursue the Wrong Goals Selecting representative humans and getting them to provide quality feedback is difficult: Selecting and instructing human evaluators in Reinforcement Learning from Human Feedback (RLHF) has led to biases. Studies found that ChatGPT models became politically