Computer Vision, Artificial Intelligence, Machine Learning, Data Science, Year In Review.
vision module with an adapter, whose weights are tuned through a multimodal task like image-text matching or contrastive learning. The MLLMs which made the most noise were OpenAI’s GPT-4 Vision and Google DeepMind’s Gemini. Additional noteworthy (and open-source!) multimodal LLMs include LLaVA,