Paper Review, Deep Learning, Rlhf, Llm, NLP.
high-scoring completions. Addressing mode collapse is complex as it can be both beneficial or harmful, depending on the context. Challenges with Jointly Training the Reward Model and Policy Joint training induces distribution shifts: Learning both a reward model and a policy simultaneously is