62.9% 62.3% 72.8% 59.4% 34.5% 11.0% 34.9%
Pretrained 60.1% 81.3% 75.3% 83.0% 80.0% 55.5% 28.8% 69.9%

Mistral 7B
Table 2: Comparison of Mistral 7B with Llama. Mistral 7B outperforms Llama 2 13B on all metrics, and
approaches the code performance of Code-Llama 7B without sacrificing performance on non-code benchmarks.

26.1% 3.9% 16.0%
11.6%
18.9%
35.4% 6.0% 34.3%
31.1% 52.5% 5.2% 20.8%
30.5% 47.5% 13.1% 52.2%
Mistral7B