odels today.
6
Limitations
While we have obtained promising experimental results, we currently consider them pre-
liminary because there are many avenues yet to explore, among them the topics of further
evaluation, including safety evaluation, and understanding the limits of iterative training.
We showed that the iterations of training improve both instruction following and reward
modeling ability, but only ran three iterations in a single setting. A clear line of further
research is to understand the “scal