r training in a
supervised fine-tuning (SFT) manner, starting from a pretrained base language model.
Subsequently this will be referred to as Instruction Fine-Tuning (IFT) data.
Seed LLM-as-a-Judge instruction following data:
We also assume we are provided
a seed set of (evaluation instruction prompt, evaluation result response) examples which
can also be used for training. While this is not strictly necessary, as the model using IFT
data will already be capable of training an LLM-as-a-Judge, we show that s