A brief history of LLaMA models - AGI Sphere

Vicuna is trained by fine-tuning the LLaMA base models on user-shared conversations
collected from ShareGPT.com. So it is basically fine-tuned with ChatGPT conversations.

It comes in two sizes: 7B and 13B.
Training

The model was fine-tuned by an academic team from UC Berkeley, CMU, Stanford, and UC
San Diego.

It was trained with user-contributed ChatGPT conversations. So you can expect its
behavior mimics ChatGPT. Precisely, it is trained with 70,000 ChatGPT conversations users
shared on ShareGPT.com.

It only costed $140 to train the 7B model and $300 to train the 13B model.
Performance

How good is Vicuna? According to their website, the output quality (as judged by GPT-4…) is
about 90% of ChatGPT, making it the best language model you can run locally.
A brief history of LLaMA models - AGI Sphere