Paper Review, Deep Learning, Rlhf, Llm, NLP.
Studies found that humans missed critical errors in summaries and security vulnerabilities, indicating that relying solely on human feedback might not suffice for advanced AI oversight. Humans can be misled, so their evaluations can be gamed: Models may exploit the difference between what is good