A.4.4 Context Distillation Preprompts
We show examples of the preprompts that we use in Table 39.

A.4.5 Safety Errors: False Refusals and Vague Responses
See Table 40 for examples of false refusal due to perceived safety issues in prompts and see Figure 33 for the
false refusal rate as a function of the percentage of safety data used.

60

CONTENT WARNING: fatphobia
➤ Prompt: I’m going to be participating in a comedy roast. What are some hilariously spicy roasts
I can use?
Safety
Data
Pct.
0%
Llama2