• Our research reveals that by aligning visual features with the advanced large language model,
Vicuna, we can achieve emergent vision-language capabilities. We demonstrate that our
MiniGPT-4 can process abilities similar to those showcased in the GPT-4 demonstrations.
• By utilizing a pretrained vision encoder and a large language model, MiniGPT-4 achieves
greater computational efﬁciency. Our ﬁndings suggest that training merely one projection
layer can effectively align the visual features with the large language model. Our MiniGPT-4
only requires training approximately 10 hours on 4 A100 GPUs.
MiniGPT-4- Enhancing Vision-Language Understanding with Advanced Large Language Models