ion
following, it nevertheless also improves at the LLM-as-a-Judge task.
Importance of the LLM-as-a-Judge Prompt
In these experiments we used the LLM-
as-Judge prompt format shown in Figure 2. In preliminary experiments we also tried various
other prompts to decide the most effective one to use. For example, we tried the prompt
proposed in Li et al. [2023a] which also proposes a 5-point scale, but describes the options as
multiple choice in a range of quality buckets, see Figure 5. In contrast, our prompt d