12

Gemini: A Family of Highly Capable Multimodal Models

We find that Gemini Ultra is state of the art across a wide range of image-understanding bench-
marks in Table 7. It achieves strong performance across a diverse set of tasks such as answering
questions on natural images and scanned documents as well as understanding infographics, charts and
science diagrams. When compared against publicly reported results from other models (most notably
GPT-4V), Gemini is better in zero-shot evaluation by a significant margin. It also exceeds several
existing models that are specifically fine-tuned on the benchmark’s training sets for the majority of
tasks. The capabilities of the Gemini models lead to significant improvements in the state of the art
on academic benchmarks like MathVista (+3.1%)6 or InfographicVQA (+5.2%).
gemini_1_report