Deep Learning, Artificial Intelligence, Vision Language Model, Bert, Contrastive Learning.
points to ease the learning of image-text alignment. The image-text pair as a triple [word tokens , object tags , region features], where the object tags (e.g.: “\dog” or \couch”) are proposed to align the cross-domain semantics. When removed, Oscar reduces to previous VLP methods. The input triple