Jeffrey Ling, Nicholas FitzGerald, Zifei Shan,
Livio Baldini Soares, Thibault F´evry, David Weiss,
and Tom Kwiatkowski. 2020.
Learning cross-
arXiv
context entity representations from text.
preprint 2001.03765.

David Eigen, Marc’Aurelio Ranzato,

and Ilya
Sutskever. 2013. Learning factored representations
arXiv preprint
in a deep mixture of experts.
1312.4314.

Robert Logan, Nelson F Liu, Matthew E Peters, Matt
Gardner, and Sameer Singh. 2019. Baracks wife
hillary: Using knowledge graphs for fact-aware lan-
guage modeling. In ACL.

4946Sewon Min, Danqi Chen, Hannaneh Hajishirzi, and
Luke Zettlemoyer. 2019a. A discrete hard em ap-
proach for weakly supervised question answering.
arXiv preprint 1909.04849.

Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob
Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz
Kaiser, and Illia Polosukhin. 2017. Attention is all
you need. In Neurips.
Entities as Experts- Sparse Memory Access with Entity Supervision