Figure 1: Our reparametriza-
tion. We only train A and B.

∗Equal contribution.
0Compared to V1, this draft includes better baselines, experiments on GLUE, and more on adapter latency.
1While GPT-3 175B achieves non-trivial performance with few-shot learning, ﬁne-tuning boosts its perfor-

mance signiﬁcantly as shown in Appendix A.

1
LORA