2.3 Llama 2 Pretrained Model Evaluation
In this section, we report the results for the Llama 1 and Llama 2 base models, MosaicML Pretrained
Transformer (MPT)†† models, and Falcon (Almazrouei et al., 2023) models on standard academic benchmarks.
For all the evaluations, we use our internal evaluations library. We reproduce results for the MPT and Falcon
models internally. For these models, we always pick the best score between our evaluation framework and
any publicly reported results.
In Table 3, we summarize the overall performance across a suite of popular benchmarks. Note that safety
benchmarks are shared in Section 4.1. The benchmarks are grouped into the categories listed below. The
results for all the individual benchmarks are available in Section A.2.2.

MBPP (Austin et al., 2021).
Llama2