Analyzing Knowledge Modification. One advantage of
utilizing knowledge memory is that we could easily add or

Figure 7. Study of Knowledge Update. The blue curve shows
result by removing certain percentage of knowledge during both
fine-tuning and inference stage. The orange curve shows results by
still first removing the knowledge, and then adding the knowledge
back during inference, which simulates the knowledge update.
REVEAL-Retrieval-AugmentedVisual-LanguagePre-Trainingwith Multi-SourceMultimodalKnowledgeMemory