WizardLM-70B (Xu et al., 2023a) has been instruction fine-tuned using large amounts of instruction
data with varying levels of complexity. It stands out as the highest-scoring open-sourced LLM on
MT-Bench with a score of 7.71. However, this is still slightly lower than the scores of GPT-3.5-
turbo (7.94) and GPT-4 (8.99). Although Zephyr-7B shows top performance in the MT-Bench, it
falls short in the Open LLM Leaderboard, scoring only 52.15%. On the other hand, GodziLLa2-70B
(Philippines, 2023), an experimental model that combines various proprietary LoRAs from Maya
Philippines 6 and the Guanaco Llama 2 1K dataset (mlabonne, 2023) with Llama-2-70B, achieves a
more competitive score of 67.01% on the Open LLM Leaderboard. Furthermore, Yi-34B pre-trained
from scratch by developers at 01.AI 7, stands out among all open-source LLMs with a remarkable
score of 68.68%. This performance is comparable to that of GPT-3.5-turbo, which scores 70.21%.
ChatGPT’sOne-yearAnniversary-AreOpen-Source LargeLanguageModelsCatchingup