Paper Review, Deep Learning, Rlhf, Llm, NLP.
of goals without having to hand-specify a reward function, and its usefulness in mitigating reward hacking. It’s helpful in allowing policies to learn complex solutions and in fine-tuning LLMs. Open problems and limitations of RLHF Challenges with Obtaining Human Feedback Misaligned Humans: