Models
Llama-2-70B-chat
WizardLM-70B
GodziLLa2-70B
Zephyr-7B
Yi-34B
GPT-3.5-turbo
GPT-4

Performance of LLMs Llama-2-
70B (Touvron et al., 2023b), a promi-
nent open-source LLM from meta, has
been pre-trained on a massive dataset
of two trillion tokens. It demonstrates
remarkable results across various gen-
eral benchmarks. When further fine-
tuned with instruction data, the Llama-
2-chat-70B variant exhibits enhanced
capabilities in general conversational
tasks. In particular, Llama-2-chat-70B achieves a 92.66% win rate in AlpacaEval, surpassing the
performance of GPT-3.5-turbo by 10.95%. Nonetheless, GPT-4 remains the top performer among all
LLMs with a win rate of 95.28%.
Zephyr-7B (Tunstall et al., 2023), another smaller model, uses distilled direct preference optimization
(Rafailov et al., 2023a) and achieves comparable results to 70B LLMs on AlpacaEval with a win rate
of 90.6%. It even surpasses Llama-2-chat-70B on MT-Bench, scoring 7.34 against 6.86. Additionally,
ChatGPT’sOne-yearAnniversary-AreOpen-Source LargeLanguageModelsCatchingup