23

[95] Yuanzhong Xu, HyoukJoong Lee, Dehao Chen, Blake A. Hechtman, Yanping Huang, Rahul Joshi, M. Krikun,
Dmitry Lepikhin, Andy Ly, Marcello Maggioni, Ruoming Pang, Noam M. Shazeer, Shibo Wang, Tao Wang,
Yonghui Wu, and Zhifeng Chen. Gspmd: General and scalable parallelization for ml computation graphs. arXiv
preprint arXiv:2105.04663, 2021.

[96] Emily Dinan, Stephen Roller, Kurt Shuster, Angela Fan, Michael Auli, and J. Weston. Wizard of wikipedia:

Knowledge-powered conversational agents. arXiv preprint arXiv:1811.01241, 2019.

[97] Angeliki Lazaridou, Adhiguna Kuncoro, Elena Gribovskaya, Devang Agrawal, Adam Liska, Tayfun Terzi, Mai
Gimenez, Cyprien de Masson d’Autume, Sebastian Ruder, Dani Yogatama, Kris Cao, Tomas Kocisky, Susannah
Young, and Phil Blunsom. Pitfalls of static language modelling. arXiv preprint arXiv:2102.01951, 2021.

[98] Spurthi Amba Hombaiah, Tao Chen, Mingyang Zhang, Michael Bendersky, and Marc Najork. Dynamic language
LaMDA- Language Models for Dialog Applications