MPT<|im_start|> system
AconversationbetweenauserandanLLM-basedAIassistant. Theassistant
gives helpful and honest answers. <|im_end|>
VicunaA chat between a curious user and an artiﬁcial intelligence assistant. The
assistant gives helpful, detailed, and polite answers to the user’s questions.
Table 31: System prompts for model generations for human evaluations.
Comparison Model Number of single turn prompts Number of multi-turn prompts
ChatGPT 1917 2256
PaLM-chat 1869 2143
Falcon 1917 1960
MPT 1917 1293
Vicuna 1917 1390
Table 32: Number of prompts for human evaluations.
56
Category Prompt
Creative writingWrite a short story about a dragon who was evil and then saw the error in [sic]
it’s ways
Identity / Personas You are a unicorn. Explain how you are actually real.
Identity / PersonasYou are one of Santa’s elves. What is the big guy like the rest of the year, not in
the holiday season?
Factual Questions How was Anne Frank’s diary discovered?
Personal & professional
development I sit in front of a computer all day. How do I manage and mitigate eye strain?
In this work, we develop and release Llama 2, a collection of pretrained and
fine-tuned large language models (LLMs) ranging in scale from 7 billion to 70
billion parameters. Our fine-tuned LLMs, called Llama 2-Chat, are optimized for
dialogue use cases. Our models outperform open-source chat models on most
benchmarks we tested, and based on our human evaluations for helpfulness and
safety, may be a suitable substitute for closed-source models. We provide a
detailed description of our approach to fine-tuning and safety improvements of
Llama 2-Chat in order to enable the community to build on our work and
contribute to the responsible development of LLMs.
Hugo Touvron Louis Martin Kevin Stone Peter Albert Amjad Almahairi Yasmine Babaei Nikolay Bashlykov Soumya Batra Prajjwal Bhargava Shruti Bhosale Dan Bikel Lukas Blecher Cristian Canton Ferrer Moya Chen Guillem Cucurull David Esiobu Jude Fernandes Jeremy Fu Wenyin Fu Brian Fuller Cynthia Gao Vedanuj Goswami Naman Goyal Anthony Hartshorn Saghar Hosseini Rui Hou Hakan Inan Marcin Kardas Viktor Kerkez Madian Khabsa Isabel Kloumann Artem Korenev Punit Singh Koura Marie-Anne Lachaux Thibaut Lavril Jenya Lee Diana Liskovich Yinghai Lu Yuning Mao Xavier Martinet Todor Mihaylov Pushkar Mishra Igor Molybog Yixin Nie Andrew Poulton Jeremy Reizenstein Rashi Rungta Kalyan Saladi Alan Schelten Ruan Silva Eric Michael Smith Ranjan Subramanian Xiaoqing Ellen Tan Binh Tang Ross Taylor Adina Williams Jian Xiang Kuan Puxin Xu Zheng Yan Iliyan Zarov Yuchen Zhang Angela Fan Melanie Kambadur Sharan Narang Aurelien Rodriguez Robert Stojnic Sergey Edunov Thomas Scialom