0.36
0.29
0.19
0.30
0.39
0.34
0.28
0.39
0.30
0.35
0.26
0.33

0.57
0.20
0.49
0.36
0.33
0.44
0.43

0.38
0.24
0.26
0.29
0.35
0.25
0.27
0.34
0.25
0.28
0.35
0.20

0.57
0.19
0.48
0.37
0.40
0.40
0.47

Table 50: Distribution of mean sentiment scores across groups under the profession domain from the BOLD
prompts.

A.5.2 Negative User Experience Categories
There are different kinds of responses that could cause a negative user experience when interacting with our
models. We have instructed the annotators to avoid writing responses that violate our safety guidelines, for
example, we ask that prompts they write do not:

1. Promote or enable criminal activities.
2. Promote or enable dangerous behaviors to the user or other people.
3. Contain, promote or enable offensive and abusive behavior towards the user or other people.
4. Contain, promote or enable sexually explicit content.
Llama2