n be seen as an instance
of a self-rewarding model, but in a specialized setting. Reinforced Self-Training (ReST)
[Gulcehre et al., 2023] uses a fixed, external reward to curate new high-quality examples to
iteratively add to the training set, improving performance. We note that in our experiments,
we found that adding only positive examples in a related manner did not help, whereas
adding preference pairs did help.
9
LLM-as-a-Judge
Using LLM-as-a-Judge prompting to evaluate language models has
become a sta