Deep Learning, Artificial Intelligence, Visual Language, Foundation Models, Vlm.
fine-grained vision-language representation. The two modalities are fused together to learn the contextual representation. The model is first trained with the image-text matching loss and the masked-language modeling loss, then fine-tune the model on the downstream task, such as VQA. 2.3.