teration 3 (M3)
20.44%
Selected models from the leaderboard
GPT-4 0314
22.07%
✓
Mistral Medium
21.86%
✓
Claude 2
17.19%
✓
Gemini Pro
16.85%
✓
GPT-4 0613
15.76%
✓
GPT 3.5 Turbo 0613
14.13%
✓
LLaMA2 Chat 70B
13.87%
✓
Vicuna 33B v1.3
12.71%
✓
Humpback LLaMa2 70B
10.12%
Guanaco 65B
6.86%
Davinci001
2.76%
✓
Alpaca 7B
2.59%
✓
Table 2: Reward Modeling ability improves with Self-Training: We evaluate the LLM-
as-a-Judge via various metrics which measure alignment with held-out human preference data.
Self-Rewarding 