Paper Review, Deep Learning, Rlhf, Llm, NLP.
demonstrations, preferences) further complicate reward learning. Some methods attempt to combine information about human goals, but they are sensitive to assumptions about human modeling, leading to a tradeoff between efficiency and accuracy. A single reward function cannot represent a diverse