Paper Review, Deep Learning, Rlhf, Llm, NLP.
intensity of preferences. Can fail to converge to true preferences due to noise or unmodeled, contextual details. May lead to policies prioritizing median performance over average performance. Scalar Feedback: More expressive than comparison-based feedback but can be poorly calibrated. Difficult