(±0.3) variance due to random seeds.
The training hyperparameters of different adaptation approaches on MNLI-n are reported in Ta-
ble 17. We use a smaller learning rate for PreﬁxLayer on the MNLI-100 set, as the training loss does
not decrease with a larger learning rate.
LORA