Improving memorization analysis with canaries Training data extraction provides a characterization of memoriza-
tion for the average sample from the training distribution. In contrast, canaries represent rare or “outlier” data points by
construction. Thus, they provide a different perspective on memorization that may not be captured by training data
extraction: they shed light on the question of how memorization manifests in data that is far from the natural training
distribution. We follow a setup similar to Carlini et al. (2019); Jagielski et al. (2022); because PaLM 2 is trained on
multilingual data, we also take care to design canaries that are rare in their source language.
PaLM 2 Technical Report