ions using Claude 2 [Anthropic, 2023] on 253 validation examples
derived from various sources following Li et al. [2023a]. This is evaluated pairwise against
1Note, the prompt, derived from Li et al. [2023a], mentions “utilizing web search”, but our model
is not actually capable of this action.
5
the previous step’s generations using the AlpacaEval evaluation prompt format [Li et al.,
2023b].
Self-Instruction creation
To generate new prompts we used a fixed model, Llama 2-Chat
70B with 8-shot prompting, whe