InternVL3: Exploring Advanced Training and Test-Time Recipes for
  Open-Source Multimodal Models
We introduce InternVL3, a significant advancement in the InternVL series
featuring a native multimodal pre-training paradigm. Rather than adapting a
text-only large language model (LLM) into a multimodal large language model
(MLLM) that supports visual inputs, InternVL3 jointly acquires multimodal and
linguistic capabilities from both diverse multimodal data and pure-text corpora
during a single pre-training stage. This unified training paradigm effectively
addresses the complexities and alignment challenges commonly encountered in
conventional post-hoc training pipelines for MLLMs. To further improve
performance and scalability, InternVL3 incorporates variable visual position
encoding (V2PE) to support extended multimodal contexts, employs advanced
post-training techniques such as supervised fine-tuning (SFT) and mixed
preference optimization (MPO), and adopts test-time scaling strategies
alongside an optimized training infrastructure. Extensive empirical evaluations
demonstrate that InternVL3 delivers superior performance across a wide range of
multi-modal tasks. In particular, InternVL3-78B achieves a score of 72.2 on the
MMMU benchmark, setting a new state-of-the-art among open-source MLLMs. Its
capabilities remain highly competitive with leading proprietary models,
including ChatGPT-4o, Claude 3.5 Sonnet, and Gemini 2.5 Pro, while also
maintaining strong pure-language proficiency. In pursuit of open-science
principles, we will publicly release both the training data and model weights
to foster further research and development in next-generation MLLMs.
67fdd08bda7816922cb67e54
Jinguo Zhu
67fdd08bda7816922cb67e55
Weiyun Wang
admin_assigned
2025-04-15T08:09:23.250Z
619507e7b74b6c591f794340
https://cdn-avatars.huggingface.co/v1/production/uploads/619507e7b74b6c591f794340/JbPDoy6Ko1V1-6oJJwFV8.jpeg
Weiyun Wang
user
Weiyun1025
67fdd08bda7816922cb67e56
Zhe Chen
claimed_verified
2025-04-23T08:37:54.102Z
64119264f0f81eb569e0d569
/avatars/00dccedea51ac7d2f398ca9d65a8e78b.svg
Zhe Chen
user
czczup
67fdd08bda7816922cb67e57
Zhaoyang Liu
67fdd08bda7816922cb67e58
Shenglong Ye
admin_assigned
2025-04-15T08:09:57.293Z
64804866c7f87934d082bb25
/avatars/41761226c79ac16e48d4c4cb84362adb.svg
Yeshenglong
user
Yeshenglong
67fdd08bda7816922cb67e59
Lixin Gu
admin_assigned
2025-04-15T08:10:04.312Z
6541efc9109d78427198ea40
/avatars/c1252dd7da2e53b0b6757bf392139cdf.svg
Lixin Gu
user
gulixin0922
67fdd08bda7816922cb67e5a
Yuchen Duan
admin_assigned
2025-04-15T08:10:30.238Z
6495a4d6d1cec0e2c2c96cdd
/avatars/e8b42301514094c8af6fa1e5fcb53119.svg
Duan Yuchen
user
duanyuchen
67fdd08bda7816922cb67e5b
Hao Tian
67fdd08bda7816922cb67e5c
Weijie Su
admin_assigned
2025-04-15T08:10:39.196Z
63e4562f9db5da2dc1f3b520
/avatars/f4eecf1396b05e1c72436e7026d85cef.svg
Weijie Su
user
jackroos
67fdd08bda7816922cb67e5d
Jie Shao
claimed_verified
2025-04-16T09:23:40.264Z
644a2bccd9a3ae834104b065
/avatars/ee2caf787796cca438349d10089bdfd1.svg
Jie Shao
user
hehesang
67fdd08bda7816922cb67e5e
Zhangwei Gao
67fdd08bda7816922cb67e5f
Erfei Cui
admin_assigned
2025-04-15T08:10:59.950Z
6579b818563044badca392fc
https://cdn-avatars.huggingface.co/v1/production/uploads/6579b818563044badca392fc/XTKQ9Lhceibp9dnQADPQF.jpeg
cuierfei
user
cuierfei
67fdd08bda7816922cb67e60
Yue Cao
admin_assigned
2025-04-15T08:11:07.485Z
6571382c7644d1128561cebe
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/bnJ-T3k_w1g1Mr7b7LglK.jpeg
Cao Yue
user
yuecao0119
67fdd08bda7816922cb67e61
Yangzhou Liu
67fdd08bda7816922cb67e62
Weiye Xu
claimed_verified
2025-04-24T09:11:23.399Z
649e5ee29420f68cf1c1470e
/avatars/7f6d1ec4fb3f85351e88044016d8ab42.svg
Xu Wayen
user
wilye
67fdd08bda7816922cb67e63
Hao Li
67fdd08bda7816922cb67e64
Jiahao Wang
claimed_verified
2025-04-16T09:23:43.045Z
664b4a748dd1bfb5a3a970fe
/avatars/37aa9332ab3e8fbb6ae30b875a7e0e5a.svg
Jiahao Wang
user
GenuineWWD
67fdd08bda7816922cb67e65
Han Lv
admin_assigned
2025-04-15T08:11:58.666Z
67c6fd7d85d2167189fce0e4
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/qpvzOJWcUJvD03l5yTBcN.jpeg
Han Lv
user
Hanrandom
67fdd08bda7816922cb67e66
Dengnian Chen
67fdd08bda7816922cb67e67
Songze Li
claimed_verified
2025-07-03T07:43:19.808Z
64acbbd51aee69ece03c6c0c
/avatars/604df1cabc5faeda55022ae4c1997e56.svg
Songze Li
user
SongzeLi
67fdd08bda7816922cb67e68
Yinan He
admin_assigned
2025-04-15T08:12:39.591Z
65b9d9961fe588f824fde191
/avatars/a9245958cc998a4b4b870bf2490fdaee.svg
Yinan He
user
yinanhe
67fdd08bda7816922cb67e69
Tan Jiang
67fdd08bda7816922cb67e6a
Jiapeng Luo
admin_assigned
2025-04-15T08:12:51.845Z
647ea4aae4d52fe0e021bce4
/avatars/9e68004d04403acff004113c856451a6.svg
Jiapeng Luo
user
woolpeeker
67fdd08bda7816922cb67e6b
Yi Wang
67fdd08bda7816922cb67e6c
Conghui He
admin_assigned
2025-04-15T08:13:07.750Z
63f9fca8d4349b157a109eec
/avatars/fa1f2ae7972d7cde99dab178136ccbb0.svg
Conghui He
user
conghui
67fdd08bda7816922cb67e6d
Botian Shi
67fdd08bda7816922cb67e6e
Xingcheng Zhang
67fdd08bda7816922cb67e6f
Wenqi Shao
admin_assigned
2025-04-15T08:15:27.767Z
64b3fd42eec33e27dcc4c941
/avatars/5aa1a99468fa61d4b8b0e80b592c4e55.svg
Wenqi Shao
user
wqshao126
67fdd08bda7816922cb67e70
Junjun He
admin_assigned
2025-04-15T08:15:19.980Z
66b593026cef22e6ba6adb8a
/avatars/8a94d55b85177e84d65dd0bd537e335f.svg
JunjunHe
user
JunjunHe
67fdd08bda7816922cb67e71
Yingtong Xiong
admin_assigned
2025-04-15T08:15:12.302Z
654395472cfe8660a3a492bb
/avatars/2010370112200e83ced979d3d4c87735.svg
xiong
user
xiongyingtong
67fdd08bda7816922cb67e72
Wenwen Qu
admin_assigned
2025-04-15T08:14:47.178Z
6684eb7045d8ceb446ffe9ff
/avatars/30586f289031696253842fcd4a8788b9.svg
wenwenQu
user
wenwenQu
67fdd08bda7816922cb67e73
Peng Sun
67fdd08bda7816922cb67e74
Penglong Jiao
67fdd08bda7816922cb67e75
Lijun Wu
67fdd08bda7816922cb67e76
Kaipeng Zhang
admin_assigned
2025-04-15T08:13:25.647Z
63527f4e7d071f23d085ad45
/avatars/99a51adef5673b3ac1a8c02eb47759c4.svg
KAIPENG ZHANG
user
kpzhang
67fdd08bda7816922cb67e77
Huipeng Deng
67fdd08bda7816922cb67e78
Jiaye Ge
67fdd08bda7816922cb67e79
Kai Chen
67fdd08bda7816922cb67e7a
Limin Wang
67fdd08bda7816922cb67e7b
Min Dou
67fdd08bda7816922cb67e7c
Lewei Lu
admin_assigned
2025-04-15T08:14:05.716Z
65ead3ea908526a39082e641
/avatars/dcf870695fd56b06ca03d82f831e9019.svg
Lewei Lu
user
luotto
67fdd08bda7816922cb67e7d
Xizhou Zhu
67fdd08bda7816922cb67e7e
Tong Lu
67fdd08bda7816922cb67e7f
Dahua Lin
admin_assigned
2025-04-15T08:13:59.084Z
636317ed80c1a705a6eff396
/avatars/3db090e101b916d9256d0d3e043db71d.svg
Dahua Lin
user
lindahua
67fdd08bda7816922cb67e80
Yu Qiao
67fdd08bda7816922cb67e81
Jifeng Dai
67fdd08bda7816922cb67e82
Wenhai Wang
admin_assigned
2025-04-15T08:13:51.523Z
64d1c560c0c627dfa71bdbe0
/avatars/f42794fe25bffcd870a1bcee69b95298.svg
wenhai.wang
user
wangwhcore
InternVL3: Exploring Advanced Training and Test-Time Recipes for
  Open-Source Multimodal Models
We introduce InternVL3, a significant advancement in the InternVL series
featuring a native multimodal pre-training paradigm. Rather than adapting a
text-only large language model (LLM) into a multimodal large language model
(MLLM) that supports visual inputs, InternVL3 jointly acquires multimodal and
linguistic capabilities from both diverse multimodal data and pure-text corpora
during a single pre-training stage. This unified training paradigm effectively
addresses the complexities and alignment challenges commonly encountered in
conventional post-hoc training pipelines for MLLMs. To further improve
performance and scalability, InternVL3 incorporates variable visual position
encoding (V2PE) to support extended multimodal contexts, employs advanced
post-training techniques such as supervised fine-tuning (SFT) and mixed
preference optimization (MPO), and adopts test-time scaling strategies
alongside an optimized training infrastructure. Extensive empirical evaluations
demonstrate that InternVL3 delivers superior performance across a wide range of
multi-modal tasks. In particular, InternVL3-78B achieves a score of 72.2 on the
MMMU benchmark, setting a new state-of-the-art among open-source MLLMs. Its
capabilities remain highly competitive with leading proprietary models,
including ChatGPT-4o, Claude 3.5 Sonnet, and Gemini 2.5 Pro, while also
maintaining strong pure-language proficiency. In pursuit of open-science
principles, we will publicly release both the training data and model weights
to foster further research and development in next-generation MLLMs.
InternVL3 is a multimodal pre-trained language model that jointly learns from both multimodal data and text, improving performance and scalability through advanced techniques and setting a new state-of-the-art in multimodal tasks.
multimodal pre-training large language model multimodal large language model variable visual position encoding supervised fine-tuning mixed preference optimization test-time scaling MMLM pure-language proficiency MMOU benchmark