Paper Review, Deep Learning, Rlhf, Llm, NLP.
biased post RLHF. OpenAI’s evaluator demographics include 50% Filipino and Bangladeshi nationals and 50% aged 25–34. Anthropic’s evaluators are primarily white (68% from 82% white initial pool). Such demographics might introduce implicit biases. The choice of instructions for evaluators presents