 it was difficult for the
model to break down this multiple-choice problem into sub-problems involving evaluating
various aspects of the response. When using the model trained on 3,200 IFT data only, its
performance on the EFT test set using our additive score-counting prompt and prompt from
Li et al. [2023a] is shown in Table 3.
EFT Prompt
Multiple Choice prompt
Ours
Pairwise accuracy (↑)
26.6%
65.1%
5-best % (↑)
23.5%
39.6%
Exact Match % (↑)
1.1%
10.1%
Spearman corr. (↑)
-0.18
0.25
Kendall τ corr. (↑)
-0.