4.1 Multilingual Translation Evaluations

Figure 7 This figure displays BLEU scores for Claude models on the Flores 200 translation benchmark. Higher
BLEU scores indicate better translation quality. Results are shown for 43 languages, demonstrating Claude’s multilingual
capabilities.

We evaluated Claude on a translation benchmark, Flores 200 [17], containing over two hundred languages.
We selected this benchmark and choice of task because of the broad coverage of languages, including low-
resource languages, which are usually not included in other task benchmarks.

8
ClaudeModels