deeply in general, and in our results in particular as well. It would also be
good to understand if so-called “’reward-hacking” can happen within our framework, and in
what circumstances. As we are using both a language model as the training reward, and
a language model for final evaluation, even if they are different models, this may require
a deeper analysis than we have provided. We conducted a preliminary human (author)
evaluation, which validated the automatic results that we see, but more detailed hum