Mean
0.028
0.069
0.16

STD
0.025
0.058
0.05

Table 8: Average normalized distance between generated prompts.

Prompt Length Prompt-Tuning

100
200
300
400

60.4
61.4
61.7
61.5

ID-PT
62.0
62.2
62.3
63.1

Table 9: Average dataset score over the development set per prompt length, for prompt tuning and
ID-PT.

19
STANDING ON THE SHOULDERS OF GIANT FROZEN LANGUAGE MODELS