ain and 531 evaluation examples (which do not overlap with the IFT data).
3.1.2
Evaluation Metrics
We evaluate the performance of our self-rewarding models in two axes: their ability to follow
instructions, and their ability as a reward model (ability to evaluate responses).
Instruction Following
We evaluate head-to-head performance between various models
using GPT-4 [Achiam et al., 2023] as an evaluator over 256 test prompts derived from various
sources following Li et al. [2023a] using the AlpacaEval eval