The results are

Koala-All is better than Alpaca but worse than ChatGPT.
Koala-Distill is slightly better than Koala-All. — This is surprising as Koala-All was fine-
tuned with more data.
Summary

The take-home message is quality of the data is more important than quantity. Koala-Distll
fine-tuned with ChatGPT data alone outperforms Koala-All trained with additional data.

Going forward, finding or generating high-quality data to fine-tune LLaMA models is going
to be important.

GPT4-x-Alpaca

HuggingFace page
Release date: April 2023

GPT4-x-Alpaca is a LLaMA 13B model fine-tuned with a collection of GPT4 conversations,
GPTeacher. There’s not a lot of information on its training and performance.

https://agi-sphere.com/llama-models/

11/18

02/05/2023, 07:05

A brief history of LLaMA models - AGI Sphere

Below are some community efforts to evaluate the model

GPT-4-x-Alpaca vs. Vicuna, GPT-4 as the judge
Discussion on performance

WizardLM
A brief history of LLaMA models - AGI Sphere