Paper Review, Deep Learning, Rlhf, Llm, NLP.
Misspecification An individual human’s values are difficult to represent with a reward function: Human preferences are complex and context-dependent, evolving over time, making them hard to accurately model. Incorrect assumptions about human decision-making can negatively impact reward inference.