set, we ﬁnd that this corrector model achieves 92% accuracy in ﬁxing errors in the prompts reconstructed from the
templates. While hybrid methods are preferred to analyze the nuanced loss patterns, fully automatic translations still
give a reasonable estimate of subgroup toxicity rates when we use multiple prompts (> 10) for each of the identity
groups. Linguists manually translated the dialog prompt from Glaese et al. (2022) for each language, but did no other
localization.
PaLM 2 Technical Report