Deep Learning, Artificial Intelligence, Vision Language Model, Bert, Contrastive Learning.
data for many V+L tasks consists of image-text pairs. A dataset of size N is denoted by D={(Ii, wi)}, with image I and text sequence w. Existing VLP methods take visual region features v={v1, …, vK} of an image and word embeddings w={w1, …, wT}, suffers from 2 issues: Ambiguity: The visual region