are due to the entity-speciﬁc modeling, we report
performance for BERT-MM which uses BERT’s
architecture with EAE’s masking function and data.
We present results for Base and Large model sizes.
Entities as Experts- Sparse Memory Access with Entity Supervision