[29] Kenneth Marino, Mohammad Rastegari, Ali Farhadi, and
Roozbeh Mottaghi. OK-VQA: A visual question answering
benchmark requiring external knowledge. In IEEE Confer-
ence on Computer Vision and Pattern Recognition, CVPR
2019, Long Beach, CA, USA, June 16-20, 2019, pages 3195–
3204. Computer Vision Foundation / IEEE, 2019. 2, 6

[30] Ron Mokady, Amir Hertz, and Amit H. Bermano. Clip-
cap: CLIP prefix for image captioning. ArXiv preprint,
abs/2111.09734, 2021. 6

[31] Medhini Narasimhan, Svetlana Lazebnik, and Alexander G.
Schwing. Out of the box: Reasoning with graph convo-
In Ad-
lution nets for factual visual question answering.
vances in Neural Information Processing Systems 31: An-
nual Conference on Neural Information Processing Systems
2018, NeurIPS 2018, December 3-8, 2018, Montr´eal, Canada,
pages 2659–2670, 2018. 2
REVEAL-Retrieval-AugmentedVisual-LanguagePre-Trainingwith Multi-SourceMultimodalKnowledgeMemory