MobileVLM V2: Faster and Stronger Baseline for Vision Language Model
We introduce MobileVLM V2, a family of significantly improved vision language
models upon MobileVLM, which proves that a delicate orchestration of novel
architectural design, an improved training scheme tailored for mobile VLMs, and
rich high-quality dataset curation can substantially benefit VLMs' performance.
Specifically, MobileVLM V2 1.7B achieves better or on-par performance on
standard VLM benchmarks compared with much larger VLMs at the 3B scale.
Notably, our 3B model outperforms a large variety of VLMs at the 7B+ scale. Our
models will be released at https://github.com/Meituan-AutoML/MobileVLM .
65c2f3261eeff9b8dba8d8b5
Xiangxiang Chu
65c2f3261eeff9b8dba8d8b6
Limeng Qiao
65c2f3261eeff9b8dba8d8b7
Xinyu Zhang
65c2f3261eeff9b8dba8d8b8
Shuang Xu
65c2f3261eeff9b8dba8d8b9
Fei Wei
65c2f3261eeff9b8dba8d8ba
Yang Yang
65c2f3261eeff9b8dba8d8bb
Xiaofei Sun
65c2f3261eeff9b8dba8d8bc
Yiming Hu
65c2f3261eeff9b8dba8d8bd
Xinyang Lin
65c2f3261eeff9b8dba8d8be
Bo Zhang
claimed_verified
2024-03-05T08:49:33.528Z
64688d93dcbb937d56b4fbae
https://cdn-avatars.huggingface.co/v1/production/uploads/64688d93dcbb937d56b4fbae/AHf01DkvhL8p_E9ldwggW.jpeg
Bo Zhang
user
boydcheung
65c2f3261eeff9b8dba8d8bf
Chunhua Shen
MobileVLM V2: Faster and Stronger Baseline for Vision Language Model
We introduce MobileVLM V2, a family of significantly improved vision language
models upon MobileVLM, which proves that a delicate orchestration of novel
architectural design, an improved training scheme tailored for mobile VLMs, and
rich high-quality dataset curation can substantially benefit VLMs' performance.
Specifically, MobileVLM V2 1.7B achieves better or on-par performance on
standard VLM benchmarks compared with much larger VLMs at the 3B scale.
Notably, our 3B model outperforms a large variety of VLMs at the 7B+ scale. Our
models will be released at https://github.com/Meituan-AutoML/MobileVLM .
MobileVLM V2 enhances vision language models through improved architecture, training, and dataset curation, achieving performance on par with or better than larger models.
vision language models architectural design training scheme dataset curation VLM benchmarks