challenge targeting commonsense knowledge. arXiv preprint arXiv:1811.00937, 2018.

Alon Talmor, Jonathan Herzig, Nicholas Lourie, and Jonathan Berant. CommonsenseQA: A question
answering challenge targeting commonsense knowledge. NAACL, 2019. doi: 10.18653/v1/N19-1421. URL
https://aclanthology.org/N19-1421.

Alon Talmor, Ori Yoran, Ronan Le Bras, Chandra Bhagavatula, Yoav Goldberg, Yejin Choi, and Jonathan
Berant. CommonsenseQA 2.0: Exposing the limits of AI through gamiﬁcation. In Thirty-ﬁfth Conference
on Neural Information Processing Systems Datasets and Benchmarks Track (Round 1), 2021. URL https://
openreview.net/forum?id=qF7FlUT5dxa.

Yi Tay, Zhe Zhao, Dara Bahri, Donald Metzler, and Da-Cheng Juan. Hypergrid: Eﬃcient multi-task trans-

formers with grid-wise decomposable hyper projections. arXiv preprint arXiv:2007.05891, 2020.

Yi Tay, Mostafa Dehghani, Jai Gupta, Dara Bahri, Vamsi Aribandi, Zhen Qin, and Donald Metzler. Are
UL2- Unifying Language Learning Paradigms