18.8

34.5

0.0

6.9

0.0

0.0

9.1

6.2

780M T5-Large

Flan-T5-Large

0.0

18.2
9.1
18.2 27.3 35.7 28.6 37.5 31.2 36.4 45.5 44.8 37.9 43.8 43.8 25.0 12.5 27.3 36.4 45.5 27.3 45.5 45.5

37.5 37.5 45.5 18.2 18.2

25.0 18.8 45.5

10.3 18.8

21.4

18.2

0.0

6.9

9.1

9.1

0.0

3B

T5-XL
Flan-T5-XL

0.0

18.2
0.0
27.3 36.4 35.7 35.7 50.0 62.5 45.5 45.5 55.2 55.2 56.2 50.0 25.0 37.5 45.5 27.3 18.2 27.3 50.0 50.0

10.3 17.2 31.2 12.5 25.0 12.5 45.5

14.3

31.2

18.2

0.0

0.0

9.1

9.1

0.0

9.1

0.0

11B T5-XXL

Flan-T5-XXL

0.0

27.3
0.0
36.4 45.5 28.6 28.6 62.5 50.0 63.6 54.5 58.6 44.8 68.8 56.2 25.0 50.0 36.4 18.2 27.3 36.4 68.2 45.5

10.3 31.0 43.8

50.0 12.5 36.4

21.4

31.2

54.5

0.0

0.0

0.0

0.0

9.1

0.0

0.0

9.1

8B

PaLM
Flan-PaLM

62B PaLM

Flan-PaLM

540B PaLM

Flan-PaLM
250M SwitchBASE

FLAN-SwitchBASE

9.1

36.4
9.1
36.4 18.2 42.9 35.7 43.8 50.0 36.4 45.5 48.3 41.4 56.2 50.0 25.0 25.0 54.5 63.6 18.2 27.3 50.0 18.2

18.8 37.5 18.2 36.4 24.1 24.1 25.0 43.8 12.5 12.5

27.3
Mixture-of-Experts