real-world usage of these models, which will likely cover a significantly larger number of use cases.

• Diversity of the prompts could be another factor in our results. For example, our prompt set does not

include any coding- or reasoning-related prompts.

• We only evaluate the final generation of a multi-turn conversation. A more interesting evaluation could be
to ask the models to complete a task and rate the overall experience with the model over multiple turns.
• Human evaluation for generative models is inherently subjective and noisy. As a result, evaluation on a

different set of prompts or with different instructions could result in different results.

19
Llama2