an
evaluation would be beneficial.
Another clear further avenue of study is to conduct safety evaluations – and to explore safety
training within our framework. Reward models have been built exclusively for safety in
existing systems [Touvron et al., 2023], and a promising avenue here would be to use the
LLM-as-a-Judge procedure to evaluate for safety specifically in our self-rewarding training
process. Given that we have shown that reward modeling ability improves over training
iterations, this could mean 