Training Data
Claude models are trained on a proprietary mix of publicly available information from the Internet, datasets
that we license from third party businesses, and data that our users affirmatively share or that crowd workers
provide. Some of the human feedback data used to finetune Claude was made public [12] alongside our
RLHF [2] and red-teaming [4] research.
Claude 2’s training data cuts off in early 2023, and roughly 10 percent of the data included was non-English.
Evaluations and Red Teaming
We test all Claude models pre-deployment with a suite of evaluations. These include capabilities evaluations
– which help us measure the model’s skills, strengths, and weaknesses across a range of tasks – as well as
safety and alignment evaluations, which evaluate whether the model poses specific risks and the degree to
which the model conforms to the ethical and behavioral expectations set for it. You can read the results of
ClaudeModels