WIT when utilized independently. However, excluding any
of these corpora from the complete dataset results in perfor-
mance decreases of 1.3%, 0.6%, and 1.1%, respectively. This
observation implies that these knowledge sources effectively
complement one another, contributing valuable information
to enhance performance. To further substantiate this hypoth-
esis, we perform an additional experiment involving pairs of
knowledge sources, as illustrated in Figure 6. Notably, even
when paired with an informative knowledge source such
as WIT, incorporating an extra corpus consistently leads to
performance improvements.
REVEAL-Retrieval-AugmentedVisual-LanguagePre-Trainingwith Multi-SourceMultimodalKnowledgeMemory