Parameter-Efﬁcient Transfer Learning for NLP

A. Additional Text Classiﬁcation Tasks

Dataset
20 newsgroups
Crowdﬂower airline
Crowdﬂower corporate messaging
Crowdﬂower disasters
Crowdﬂower economic news relevance
Crowdﬂower emotion
Crowdﬂower global warming
Crowdﬂower political audience
Crowdﬂower political bias
Crowdﬂower political message
Crowdﬂower primary emotions
Crowdﬂower progressive opinion
Crowdﬂower progressive stance
Crowdﬂower US economic performance
Customer complaint database
News aggregator dataset
SMS spam collection

15076
11712
2494
8688
6392
32000
3380
4000
4000
4000
2019
927
927
3961
146667
338349
4459

Train examples Validation examples Test examples Classes Avg text length

1885
1464
312
1086
799
4000
422
500
500
500
252
116
116
495
18333
42294
557

1885
1464
312
1086
800
4000
423
500
500
500
253
116
116
496
18334
42294
558

20
3
4
2
2
13
2
2
2
9
18
3
4
2
157
4
2
Parameter-Efficient Transfer Learning for NLP