Analytical writing (2-shot)

5.0 (~91st percentile)

4.3.2 Multistate Bar Examination (MBE) [32]

We tested Claude 2 on NCBE’s official 2021 MBE practice exam [33]. We evaluated it 5-shot without using
chain of thought on these multiple choice questions.

MBE (5-shot)

76.5% (153/200)

4.3.3 United States Medical Licensing Examination (USMLE) [34]
ClaudeModels