WizardLM 13B v1.2
Mistral 7B Instruct
Llama 2 13B Chat
Vicuna 13B
Llama 2 7B Chat
Vicuna 7B
Alpaca 13B
Table 3: Comparison of Chat models. Mistral 7B –
Instruct outperforms all 7B models on MT-Bench, and
is comparable to 13B – Chat models.

7.2
6.84 +/- 0.07
6.65
6.57
6.27
6.17
4.53

1047
1031
1012
1041
985
997
914

4

Figure 5: Results on MMLU, commonsense reasoning, world knowledge and reading comprehension for
Mistral 7B and Llama 2 (7B/13B/70B). Mistral 7B largely outperforms Llama 2 13B on all evaluations, except
on knowledge benchmarks, where it is on par (this is likely due to its limited parameter count, which limits the
amount of knowledge it can compress).

5 Adding guardrails for front-facing applications
Mistral7B