5.1.2. Trends in Capabilities
We investigate the trends in capabilities across the Gemini model family by evaluating them on a
holistic harness of more than 50 benchmarks in six different capabilities, noting that some of the
most notable benchmarks were discussed in the last section. These capabilities are: “Factuality”
covering open/closed-book retrieval and question answering tasks; “Long-Context” covering long-
form summarization, retrieval and question answering tasks; “Math/Science” including tasks for
mathematical problem solving, theorem proving, and scientific exams; “Reasoning” tasks that require
arithmetic, scientific, and commonsense reasoning; “Multilingual” tasks for translation, summarization,
and reasoning in multiple languages. Please see appendix for a detailed list of tasks included for each
capability.

Figure 3 | Language understanding and generation performance of Gemini model family across
different capabilities (normalized by the Gemini Pro model).
gemini_1_report