Though closed-book approaches are still be-
hind open-book approaches on TriviaQA, we be-

lieve even higher performances could be attained
by ensembling diverse approaches and a prelimi-
nary study (Appendix F), indicates that ensembling
open-book with closed-book approaches is prefer-
able to ensembling within a single paradigm.
Entities as Experts- Sparse Memory Access with Entity Supervision