enable base models tuned to perform well on more downstream tasks (including hate speech detection),
and it carries less risk of accidentally filtering out some demographic groups. We observe that models
trained from less aggressively filtered pretraining data also required fewer examples to achieve reasonable
safety-alignment. We reiterate that this motivated choice does imply that additional safety mitigations should
be applied before deployment of base Llama 2 models.
Llama2