Paper Review, Deep Learning, Rlhf, Llm, NLP.
society of humans: RLHF is often aimed at aligning AI with a single human, ignoring the vast diversity in human preferences, expertise, and capabilities. Human evaluators often don’t agree on feedback. Some studies show agreement rates between 63% to 77%. Condensing feedback from a variety of