AI technique (Bai et al., 2022b) signiﬁcantly cuts down on
human labor and makes these values more explicit: Using
this technique, a model can be trained to follow a set of
norms and values simply by writing those values down in
the form of a list of constraints called a constitution. It is
possible to use techniques like this to dramatically reduce
explicit examples of widely-recognized biases, like anti-
Black racism, in model behavior (Ganguli et al., 2023).5
Indeed, in some cases, exposing models to more examples
of unwanted behavior during pretraining can make it easier
to make them avoid that behavior in deployment, reversing
the intuitive link between training data and model behavior
(Korbak et al. 2023; see also Appendix C in Chung et al.
2022).
These technical interventions, especially constitutional AI,
are amenable to outside inﬂuence and regulation. One can
easily imagine third-party standards bodies collecting input
about what behaviors are acceptable in AI systems and
Eight Things to Know about Large Language Models