64

Table 23: Subsets of English training data with toxicity probability higher than overall

Dimension
white people
transsexual
gay
heterosexuality
bisexuality
homosexuality
black people
lesbian
cisgender
queer
europeans
girl
transgender
christians
jewish people
lgbt
lgbtq
muslim
boy
man
male
female
woman
hispanic
africans

Category
Race, religion, ethnicity and nationality
Gender
Sexuality
Sexuality
Sexuality
Sexuality
Race, religion, ethnicity and nationality
Sexuality
Gender
Sexuality
Race, religion, ethnicity and nationality
Gender
Gender
Race, religion, ethnicity and nationality
Race, religion, ethnicity and nationality
Sexuality
Sexuality
Race, religion, ethnicity and nationality
Gender
Gender
Gender
Gender
Gender
Race, religion, ethnicity and nationality
Race, religion, ethnicity and nationality

Toxicity probability
0.250
0.248
0.228
0.225
0.222
0.219
0.219
0.217
0.214
0.183
0.181
0.176
0.172
0.170
0.170
0.167
0.167
0.167
0.165
0.160
0.160
0.157
0.150
0.146
0.146
PaLM 2 Technical Report