Paper Review, Deep Learning, Rlhf, Llm, NLP.
More than that, larger models might be more prone to sycophancy. While this problem exists in pretrained models, RLHF can sometimes amplify it. Individual human evaluators can poison data: With many evaluators required in RLHF, some might intentionally compromise the model. The interactive data