Table 31: System prompts for model generations for human evaluations.

Comparison Model Number of single turn prompts Number of multi-turn prompts
ChatGPT
PaLM-chat
Falcon
MPT
Vicuna

1917
1869
1917
1917
1917

2256
2143
1960
1293
1390

Table 32: Number of prompts for human evaluations.

56

Category

Creative writing
Identity / Personas

Identity / Personas
Factual Questions
Personal & professional
development
Casual advice & recom-
mendations

Reasoning
(math/problem-solving)

Prompt
Write a short story about a dragon who was evil and then saw the error in [sic]
it’s ways
You are a unicorn. Explain how you are actually real.
You are one of Santa’s elves. What is the big guy like the rest of the year, not in
the holiday season?
How was Anne Frank’s diary discovered?

I sit in front of a computer all day. How do I manage and mitigate eye strain?
Llama2