Figure 5: Bias Benchmarks. Compared Llama 2 70B,
Mixtral presents less bias (higher accuracy on BBQ, lower
std on BOLD) and displays more positive sentiment (higher
avg on BOLD).

0.293 ± 0.073
0.218 ± 0.073
0.188 ± 0.133
0.149 ± 0.140
0.232 ± 0.049

0.323 ±0.045
0.243 ± 0.087
0.144 ± 0.089
0.186 ± 0.146
0.232 ± 0.052

4

Instruction Fine-tuning

We train Mixtral – Instruct using supervised fine-tuning (SFT) on an instruction dataset followed by
Direct Preference Optimization (DPO) [25] on a paired feedback dataset. Mixtral – Instruct reaches a
score of 8.30 on MT-Bench [33] (see Table 2), making it the best open-weights model as of December
2023. Independent human evaluation conducted by LMSys is reported in Figure 63 and shows that
Mixtral – Instruct outperforms GPT-3.5-Turbo, Gemini Pro, Claude-2.1, and Llama 2 70B chat.
Mixtral of Experts paper