Deep Learning, Artificial Intelligence, Vision Language Model, Bert, Contrastive Learning.
set of “polluted” image representations is sampled by replacing q with probability 50% with a different tag sequence randomly sampled from the dataset D. A fully-connected (FC) layer f() is on the top of the fused representation, to predict whether the pair contains the original image