UL2: Unifying Language Learning Paradigms

Yi Tay∗ Mostafa Dehghani∗

Vinh Q. Tran(cid:93) Xavier Garcia(cid:93)

Jason Wei(cid:93) Xuezhi Wang(cid:93) Hyung Won Chung(cid:93)

Siamak Shakeri(cid:93) Dara Bahri(cid:91) Tal Schuster(cid:91)

Huaixiu Steven Zheng(cid:52)

Denny Zhou(cid:52) Neil Houlsby(cid:52) Donald Metzler(cid:52)

Google Brain

Abstract
UL2- Unifying Language Learning Paradigms