Paper Review, Deep Learning, Rlhf, Llm, NLP.
another area where biases can be introduced, and research into this area is lacking. Some evaluators have harmful biases and opinions: Some human evaluators have harmful or biased opinions. Language models trained through RL can end up pandering to these biases, a phenomenon termed “sycophancy”.