Deep Learning, Artificial Intelligence, Vision Language Model, Bert, Contrastive Learning.
by minimizing the negative log-likelihood: This is similar to masked language model used by BERT, but with additional image information attended. 1.4. Modality View: Contrastive Loss For each input triple, h’=[q, v] is used to represent the image modality, and consider w as the language modality. A