Expanding Performance Boundaries of Open-Source Multimodal Models with
  Model, Data, and Test-Time Scaling
We introduce InternVL 2.5, an advanced multimodal large language model (MLLM)
series that builds upon InternVL 2.0, maintaining its core model architecture
while introducing significant enhancements in training and testing strategies
as well as data quality. In this work, we delve into the relationship between
model scaling and performance, systematically exploring the performance trends
in vision encoders, language models, dataset sizes, and test-time
configurations. Through extensive evaluations on a wide range of benchmarks,
including multi-discipline reasoning, document understanding, multi-image /
video understanding, real-world comprehension, multimodal hallucination
detection, visual grounding, multilingual capabilities, and pure language
processing, InternVL 2.5 exhibits competitive performance, rivaling leading
commercial models such as GPT-4o and Claude-3.5-Sonnet. Notably, our model is
the first open-source MLLMs to surpass 70% on the MMMU benchmark, achieving a
3.7-point improvement through Chain-of-Thought (CoT) reasoning and showcasing
strong potential for test-time scaling. We hope this model contributes to the
open-source community by setting new standards for developing and applying
multimodal AI systems. HuggingFace demo see
https://huggingface.co/spaces/OpenGVLab/InternVL
67566e828ebab4432d79e036
Zhe Chen
claimed_verified
2024-12-09T13:26:06.378Z
64119264f0f81eb569e0d569
/avatars/00dccedea51ac7d2f398ca9d65a8e78b.svg
Zhe Chen
user
czczup
67566e828ebab4432d79e037
Weiyun Wang
admin_assigned
2024-12-09T10:28:28.573Z
619507e7b74b6c591f794340
https://cdn-avatars.huggingface.co/v1/production/uploads/619507e7b74b6c591f794340/JbPDoy6Ko1V1-6oJJwFV8.jpeg
Weiyun Wang
user
Weiyun1025
67566e828ebab4432d79e038
Yue Cao
admin_assigned
2024-12-09T14:53:13.194Z
6571382c7644d1128561cebe
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/bnJ-T3k_w1g1Mr7b7LglK.jpeg
Cao Yue
user
yuecao0119
67566e828ebab4432d79e039
Yangzhou Liu
67566e828ebab4432d79e03a
Zhangwei Gao
67566e828ebab4432d79e03b
Erfei Cui
admin_assigned
2024-12-09T14:53:42.295Z
6579b818563044badca392fc
https://cdn-avatars.huggingface.co/v1/production/uploads/6579b818563044badca392fc/XTKQ9Lhceibp9dnQADPQF.jpeg
cuierfei
user
cuierfei
67566e828ebab4432d79e03c
Jinguo Zhu
67566e828ebab4432d79e03d
Shenglong Ye
admin_assigned
2024-12-09T14:54:01.072Z
64804866c7f87934d082bb25
/avatars/41761226c79ac16e48d4c4cb84362adb.svg
Yeshenglong
user
Yeshenglong
67566e828ebab4432d79e03e
Hao Tian
67566e828ebab4432d79e03f
Zhaoyang Liu
claimed_verified
2024-12-16T13:44:32.850Z
6432c6152bfb2b0ec7572479
/avatars/7c2f908f511cdfa38a19e967d86f9c40.svg
Zhaoyang Liu
user
zyliu
67566e828ebab4432d79e040
Lixin Gu
admin_assigned
2024-12-09T14:54:31.774Z
6541efc9109d78427198ea40
/avatars/c1252dd7da2e53b0b6757bf392139cdf.svg
Lixin Gu
user
gulixin0922
67566e828ebab4432d79e041
Xuehui Wang
admin_assigned
2024-12-09T14:54:37.913Z
649cf4ecdd87dd9ef76fe020
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/M7RpD_AcNewA2xADhhyCB.jpeg
Xuehui Wang
user
huiserwang
67566e828ebab4432d79e042
Qingyun Li
claimed_verified
2025-01-29T17:17:36.101Z
637f100c1dbae09191088e4c
https://cdn-avatars.huggingface.co/v1/production/uploads/1669271529782-noauth.jpeg
Qingyun Li
user
Qingyun
67566e828ebab4432d79e043
Yimin Ren
claimed_verified
2024-12-09T11:05:43.337Z
643375324521083b9d2c4f85
/avatars/a15b0aad0e2e61cf76dcb2559350a0d4.svg
qishisuren
user
qishisuren
67566e828ebab4432d79e044
Zixuan Chen
67566e828ebab4432d79e045
Jiapeng Luo
admin_assigned
2024-12-09T14:54:53.943Z
647ea4aae4d52fe0e021bce4
/avatars/9e68004d04403acff004113c856451a6.svg
Jiapeng Luo
user
woolpeeker
67566e828ebab4432d79e046
Jiahao Wang
67566e828ebab4432d79e047
Tan Jiang
67566e828ebab4432d79e048
Bo Wang
67566e828ebab4432d79e049
Conghui He
admin_assigned
2024-12-09T14:55:15.998Z
63f9fca8d4349b157a109eec
/avatars/fa1f2ae7972d7cde99dab178136ccbb0.svg
Conghui He
user
conghui
67566e828ebab4432d79e04a
Botian Shi
admin_assigned
2024-12-09T14:55:21.527Z
643df87f7cd64d872cb9fabd
/avatars/c53bfabcee08de448dde973915e8b31d.svg
Botian Shi
user
friskit
67566e828ebab4432d79e04b
Xingcheng Zhang
67566e828ebab4432d79e04c
Han Lv
67566e828ebab4432d79e04d
Yi Wang
67566e828ebab4432d79e04e
Wenqi Shao
admin_assigned
2024-12-09T14:55:36.969Z
64b3fd42eec33e27dcc4c941
/avatars/5aa1a99468fa61d4b8b0e80b592c4e55.svg
Wenqi Shao
user
wqshao126
67566e828ebab4432d79e04f
Pei Chu
claimed_verified
2024-12-13T15:23:13.940Z
64c9beb2904317f42de06dd8
https://cdn-avatars.huggingface.co/v1/production/uploads/64c9beb2904317f42de06dd8/he3rxfyzfwEd1vLuK6_o2.jpeg
Pei Chu
user
chupei
67566e828ebab4432d79e050
Zhongying Tu
67566e828ebab4432d79e051
Tong He
claimed_verified
2025-07-17T13:57:13.619Z
6747ede3a9c72aebe1322382
https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/inILqQ05sESbYLdsEldJ_.png
Tong He
user
tonghe90
67566e828ebab4432d79e052
Zhiyong Wu
admin_assigned
2024-12-09T14:56:51.919Z
6280e830e99dccaac4bbfde5
/avatars/9242b8d2826ce2f79af9bb794bba2b61.svg
Zhiyong Wu
user
zy001
67566e828ebab4432d79e053
Huipeng Deng
67566e828ebab4432d79e054
Jiaye Ge
67566e828ebab4432d79e055
Kai Chen
67566e828ebab4432d79e056
Min Dou
67566e828ebab4432d79e057
Lewei Lu
admin_assigned
2024-12-09T14:56:23.742Z
65ead3ea908526a39082e641
/avatars/dcf870695fd56b06ca03d82f831e9019.svg
Lewei Lu
user
luotto
67566e828ebab4432d79e058
Xizhou Zhu
admin_assigned
2024-12-09T14:56:16.640Z
64ae2359179421d320b1694b
/avatars/c387a75191005bcaa473091de5383a10.svg
Xizhou Zhu
user
Einsiedler
67566e828ebab4432d79e059
Tong Lu
67566e828ebab4432d79e05a
Dahua Lin
admin_assigned
2024-12-09T14:56:09.597Z
636317ed80c1a705a6eff396
/avatars/3db090e101b916d9256d0d3e043db71d.svg
Dahua Lin
user
lindahua
67566e828ebab4432d79e05b
Yu Qiao
67566e828ebab4432d79e05c
Jifeng Dai
admin_assigned
2024-12-09T14:56:01.974Z
64686f7172d9180d4ac8b4e4
/avatars/db67dd6c4b2b41054ddcce5a18ade6f8.svg
Jifeng Dai
user
daijifeng
67566e828ebab4432d79e05d
Wenhai Wang
admin_assigned
2024-12-09T14:55:54.685Z
64d1c560c0c627dfa71bdbe0
/avatars/f42794fe25bffcd870a1bcee69b95298.svg
wenhai.wang
user
wangwhcore
Expanding Performance Boundaries of Open-Source Multimodal Models with
  Model, Data, and Test-Time Scaling
We introduce InternVL 2.5, an advanced multimodal large language model (MLLM)
series that builds upon InternVL 2.0, maintaining its core model architecture
while introducing significant enhancements in training and testing strategies
as well as data quality. In this work, we delve into the relationship between
model scaling and performance, systematically exploring the performance trends
in vision encoders, language models, dataset sizes, and test-time
configurations. Through extensive evaluations on a wide range of benchmarks,
including multi-discipline reasoning, document understanding, multi-image /
video understanding, real-world comprehension, multimodal hallucination
detection, visual grounding, multilingual capabilities, and pure language
processing, InternVL 2.5 exhibits competitive performance, rivaling leading
commercial models such as GPT-4o and Claude-3.5-Sonnet. Notably, our model is
the first open-source MLLMs to surpass 70% on the MMMU benchmark, achieving a
3.7-point improvement through Chain-of-Thought (CoT) reasoning and showcasing
strong potential for test-time scaling. We hope this model contributes to the
open-source community by setting new standards for developing and applying
multimodal AI systems. HuggingFace demo see
https://huggingface.co/spaces/OpenGVLab/InternVL
InternVL 2.5, an advanced multimodal large language model, showcases competitive performance across various benchmarks, including multimodal reasoning and understanding, and is the first open-source model to surpass 70% on the MMMU benchmark using Chain-of-Thought reasoning.
multimodal large language model vision encoders language models dataset sizes test-time configurations multi-discipline reasoning document understanding multi-image/video understanding real-world comprehension multimodal hallucination detection visual grounding multilingual capabilities pure language processing Chain-of-Thought reasoning test-time scaling MMMU benchmark GPT-4 Claude-3.5-Sonnet