Howard, J. and Ruder, S. Universal language model ﬁne-

Cer, D., Yang, Y., Kong, S.-y., Hua, N., Limtiaco, N., John,
R. S., Constant, N., Guajardo-Cespedes, M., Yuan, S.,
Tar, C., et al. Universal sentence encoder. arXiv preprint
arXiv:1803.11175, 2018.

Cer, D., Yang, Y., Kong, S.-y., Hua, N., Limtiaco, N.,
St. John, R., Constant, N., Guajardo-Cespedes, M., Yuan,
S., Tar, C., Strope, B., and Kurzweil, R. Universal sen-
tence encoder for english. In EMNLP, 2019.

Chen, T., Lucic, M., Houlsby, N., and Gelly, S. On self
modulation for generative adversarial networks. ICLR,
2019.

Choi, E., Hewlett, D., Uszkoreit, J., Polosukhin, I., Lacoste,
A., and Berant, J. Coarse-to-ﬁne question answering for
long documents. In ACL, 2017.

Collobert, R. and Weston, J. A uniﬁed architecture for
natural language processing: Deep neural networks with
multitask learning. In ICML, 2008.
Parameter-Efficient Transfer Learning for NLP