Paper Review, Deep Learning, Rlhf, Llm, NLP.
formalized as a form of Bayesian inference, where the base model determines the prior, but it’s more of a convenience than a principled method. This leads to inheriting harmful biases present in internet text (such as demographic biases), which can persist through the RLHF training process. An