1
2
3
4
5
6
7
8
9

import numpy as np
import matplotlib.pyplot as plt
x = np.linspace(0, 10, 1000)
y1 = np.sin(x)
y2 = np.exp(x)
plt.plot(x, 1000∗y1 + y2)
plt.show()

Rendered Graph

Figure 20 | Multimodal reasoning capabilities applied to code generation. Gemini Ultra needs to
perform inverse graphics task to infer the code that would have generated the plots, perform additional
mathematical transformations, and generate relevant code.
Source: figure generated by an author from the Gemini team.

59

Gemini: A Family of Highly Capable Multimodal Models

9.5.2. Video understanding and reasoning

Prompt (video)
gemini_1_report