uation prompt [Li et al., 2023b].
We try the prompt in both orders comparing pairwise, and if the GPT-4 evaluations disagree
we count the result as a tie. We also report results in the AlpacaEval 2.0 leaderboard format
which is evaluated over 805 prompts, and compute the win rate against the baseline GPT-4
Turbo model based on GPT-4 judgments.
Reward Modeling
We evaluate the correlation with human rankings on the evaluation set
we derived from the Open Assistant dataset, as described in Section 3.1.1. Each 