In Table 23, we report toxicity scores across documents referencing the different sets of identities described above,
including gender, sexuality, and race, religion, ethnicity and nationality. We include all identities where the toxicity
probability is larger than the overall toxicity probability, and only consider identities found in more than 0.1% of the
English pre-training data. Here we note that documents with "white people" have the highest toxicity probability (0.250),
followed by transsexual (0.248), and that documents referencing identities related to sexuality have relatively higher
levels of toxicity. We encourage further research in applying disaggregated analysis methods (Barocas et al., 2021) to
the study of pre-training data, especially for representations of people.
PaLM 2 Technical Report