Table 6: Probability of generating a comment that could be perceived as toxic (i.e. toxicity score >= 0.5) at
least once in 25 continuations for diﬀerent model sizes. We compute the toxicity probability for “Toxic” and
“Non-Toxic” prompts and report the results as such. For PaLM, we report the metric on the ﬁrst complete
sentence output.
In Table 6, we observe that the probability of instruction ﬁnetuned Flan models to produce toxic continuations
is lower at all scales, and that this eﬀect holds for both sets of input prompts.
In Figure 12, we additionally compare Flan models to PaLM using the procedure in Chowdhery et al. (2022),
adapted from Rae et al. (2021b). This scaling plot shows the average toxicity probability of the continuation
(TPC) as a function of the binned toxicity probability of the prompt (TPP) for diﬀerent model sizes. We
include PaLM-540B as a representative baseline, and show that Flan models have lower TPC at all scales,
Scaling Instruction-Finetuned Language Models