Vision Language Model, Knowledge Graph, Generative Model.
two main issues associated with them. First, they focus on adapting models using knowledge from a single modality (either text or images) which means that they don’t fully utilise the relationship between the two modalities. For example, consider an image of a cat and a dog playing together.