escribes
the points as additive, covering various aspects of quality. We find a large difference between
8
these two prompts when using the SFT Baseline, e.g. 65.1% pairwise accuracy for ours, and
only 26.6% pairwise accuracy for theirs. See Section A.2 for further details.
4
Related Work
Automatically improving or self-correcting large language models is becoming a major focus
of research. A recent survey from Pan et al. [2023] attempts to summarize the topic. However,
this is a rapidly moving area, and th