lossﬁnetune = lossfact + lossans

A.3 Model Parameters
The number of Base parameters includes the en-
coder and (where applicable) decoder transformer
parameters derived from the original papers. We
exclude token embeddings in this count following
prior work. The Memory parameter count for DPR,
RAG, and FID includes the number of parameters
required to cache and index the full 26 million pas-
sage wikipedia corpus with dimension 768 used by
those models. For EaE, the Memory is for the entity
embedding matrix. For FILM it is both the entity
embedding matrix and the cached fact embedding
matrix comprised of the 1.7 million precomputed
triple embeddings.

3691
Adaptable and Interpretable Neural Memory Over Symbolic Knowledge