current Claude models possess the dangerous capabilities (‘autonomous replication’ abilities) that ARC is
aiming to detect, though we continue to develop and test the robustness of the evaluations.
Before deployment, we also worked with external red teamers, including crowdworker platforms, to test
Claude 2 on a range of Trust and Safety related topics – these results were integrated into our safety mitiga-
tions. We will continue to build relationships with experts across academia and civil society to red team all
our Trust and Safety abuse verticals, including misinformation, hate and discrimination, and child safety.
We want to ensure our models do not exhibit harmful bias or contribute to discrimination. We have im-
plemented mitigations around bias, which we detail in section 3.2. We evaluated Claude 2 with the Bias
Benchmark for QA (BBQ), and were pleased to find that it is less biased than Claude 1 models.
ClaudeModels