10

Avg. # Turns
per Dialogue

Avg. # Tokens
per Example

Avg. # Tokens

in Prompt

Avg. # Tokens
in Response

Dataset
Anthropic Helpful
Anthropic Harmless
OpenAI Summarize
OpenAI WebGPT
StackExchange
Stanford SHP
Synthetic GPT-J
Meta (Safety & Helpfulness)
Total

Num. of
Comparisons
122,387
43,966
176,625
13,333
1,038,480
74,882
33,139
1,418,091
2,919,326

3.0
3.0
1.0
1.0
1.0
1.0
1.0
3.9
1.6

251.5
152.5
371.1
237.2
440.2
338.3
123.3
798.5
595.7

17.7
15.7
336.0
48.3
200.1
199.5
13.0
31.4
108.2

88.4
46.4
35.1
188.9
240.2
138.8
110.3
234.1
216.9
Llama2