Sewon Min, Danqi Chen, Luke Zettlemoyer, and Han-
naneh Hajishirzi. 2019b. Knowledge guided text re-
trieval and reading for open domain question answer-
ing. arXiv preprint 1911.03868.

Matthew E Peters, Mark Neumann, Mohit Iyyer, Matt
Gardner, Christopher Clark, Kenton Lee, and Luke
Zettlemoyer. 2018. Deep contextualized word repre-
sentations. arXiv preprint 1802.05365.

Ruize Wang, Duyu Tang, Nan Duan, Zhongyu Wei,
Xuanjing Huang, Cuihong Cao, Daxin Jiang, Ming
Zhou, et al. 2020. K-adapter:
Infusing knowl-
edge into pre-trained models with adapters. arXiv
preprint 2002.01808.

Jason Weston, Sumit Chopra, and Antoine Bor-
arXiv preprint

des. 2014. Memory networks.
1410.3916.

Matthew E Peters, Mark Neumann, Robert L Logan,
IV, Roy Schwartz, Vidur Joshi, Sameer Singh, and
Noah A Smith. 2019. Knowledge enhanced contex-
tual word representations. arXiv.
Entities as Experts- Sparse Memory Access with Entity Supervision