)
39.6%
41.5%
44.3%
43.2%
Exact Match % (↑)
10.1%
13.1%
14.3%
14.3%
Spearman corr. (↑)
0.253
0.279
0.331
0.349
Kendall τ corr. (↑)
0.233
0.253
0.315
0.324
to M2, for example pairwise accuracy increases from 80.4% to 81.7%. This performance gain
is achieved despite there being no additional EFT data provided, and the examples created
during the Self-Instruction creation loop do not tend to look like LLM-as-a-Judge training
examples. We hypothesize that because the model is becoming better at general instruct