24

Figure 10: Control tokens are effective at inﬂuencing the Toxicity Probability of Continuation

Conversational language modeling and in dialog uses We also measure the impact of conditioning on control tokens
within conversational language modeling and dialog uses. We use the standard and adversarial datasets from Dinan et al.
(2019) and analyze results based on drawing a single sample. See Appendix E.3 and E.7.1 for description of methods
and related analysis.

In conversational language modeling, we see that PaLM 2 provides an effective inference-time control method, reducing
the percentage of toxic responses from 30% to 12% on the standard dataset, and 18% to 7% on the adversarial dataset.
PaLM 2 Technical Report