Vision Language Model, Knowledge Graph, Generative Model.
Focusing solely on the image might lead the model to identify individual objects (cat, dog) but miss the interaction between them. Likewise, focusing solely on the text description might not capture the visual details of the scene. Second, they do not fully leverage the structured knowledge of