eline
Firstly, we find that adding Eval-
uation Fine-Tuning (EFT) data into training, which gives examples to the model of how
to act as an LLM-as-a-Judge, naturally improves its performance compared to training
with Instruction Fine-Tuning (IFT) data alone. IFT data covers a wide range of general
instruction tasks, and so does endow the SFT Baseline with the ability to evaluate responses,
however EFT data gives more examples of this specific task. We find improvements across
all five metrics measured when 