CogVLM2: Visual Language Models for Image and Video Understanding
Beginning with VisualGLM and CogVLM, we are continuously exploring VLMs in
pursuit of enhanced vision-language fusion, efficient higher-resolution
architecture, and broader modalities and applications. Here we propose the
CogVLM2 family, a new generation of visual language models for image and video
understanding including CogVLM2, CogVLM2-Video and GLM-4V. As an image
understanding model, CogVLM2 inherits the visual expert architecture with
improved training recipes in both pre-training and post-training stages,
supporting input resolution up to 1344 times 1344 pixels. As a video
understanding model, CogVLM2-Video integrates multi-frame input with timestamps
and proposes automated temporal grounding data construction. Notably, CogVLM2
family has achieved state-of-the-art results on benchmarks like MMBench,
MM-Vet, TextVQA, MVBench and VCGBench. All models are open-sourced in
https://github.com/THUDM/CogVLM2 and https://github.com/THUDM/GLM-4,
contributing to the advancement of the field.
66d1255a3b8f08e1b2de17be
Wenyi Hong
admin_assigned
2024-08-30T07:19:24.884Z
62ecd24cb8764c7738ef2793
/avatars/c1b80b5c55f9d652c1aaac7919e1fa32.svg
Wenyi Hong
user
wenyi
66d1255a3b8f08e1b2de17bf
Weihan Wang
claimed_verified
2025-07-02T12:23:29.542Z
63403c75b8b51e0098d3555c
/avatars/85725280b63788e387fe73319a54164d.svg
王维汉
user
mactavish91
66d1255a3b8f08e1b2de17c0
Ming Ding
66d1255a3b8f08e1b2de17c1
Wenmeng Yu
admin_assigned
2024-08-30T07:24:30.771Z
649d3d271bafbcc83acec930
/avatars/0c42aabf4c6601686c22cc1308c318de.svg
Wenmeng Yu
user
iyuge2
66d1255a3b8f08e1b2de17c2
Qingsong Lv
admin_assigned
2024-08-30T07:24:37.541Z
61bd8ac694bd578f7286181b
/avatars/ff14b64339217858927ae01c2b2fa28d.svg
Qingsong Lv
user
qingsonglv
66d1255a3b8f08e1b2de17c3
Yan Wang
claimed_verified
2025-07-02T12:23:09.283Z
6441529fb3e14d9ba7b79d61
/avatars/79e81bbde65b5caaa6f7c000bba25296.svg
Yan
user
lykeven
66d1255a3b8f08e1b2de17c4
Yean Cheng
admin_assigned
2024-08-30T07:27:04.116Z
65acc5afe2a2c8635614de43
/avatars/c5fce792792cc0b52ed7475d72460c58.svg
Yean Cheng
user
LiquidAmmonia
66d1255a3b8f08e1b2de17c5
Shiyu Huang
admin_assigned
2024-08-30T07:27:10.517Z
6406db5cd684369027166986
https://cdn-avatars.huggingface.co/v1/production/uploads/6406db5cd684369027166986/Zl-orrGcbY0RbfjfKszn1.jpeg
Shiyu Huang
user
ShiyuHuang
66d1255a3b8f08e1b2de17c6
Junhui Ji
claimed_verified
2025-07-02T08:32:52.495Z
649cffffe89a765015a243a4
/avatars/20753e7ed68d1fad6ff633101b0ee2e4.svg
Junhui Ji
user
jasonnoy
66d1255a3b8f08e1b2de17c7
Zhao Xue
claimed_verified
2025-07-02T12:23:20.697Z
6865034aabd541be6b66c5f7
https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/6lOkw7oiy7H8M7YwSYE2c.png
xuezhao
user
xuezhao998
66d1255a3b8f08e1b2de17c8
Lei Zhao
66d1255a3b8f08e1b2de17c9
Zhuoyi Yang
admin_assigned
2024-08-30T07:28:04.753Z
6466d1640ed2f7a8cba87503
/avatars/652746e63dfeb5154ae7d34039d1a485.svg
Zhuoyi Yang
user
zyyangzy
66d1255a3b8f08e1b2de17ca
Xiaotao Gu
claimed_verified
2025-07-02T09:25:08.318Z
6438bca4a5e10f6d58694b47
/avatars/3aeb25fbc73c5cab1265e13d11adfb76.svg
XG
user
xgeric
66d1255a3b8f08e1b2de17cb
Xiaohan Zhang
66d1255a3b8f08e1b2de17cc
Guanyu Feng
admin_assigned
2024-08-30T07:54:14.645Z
64d996d6bcab729cb400cb70
/avatars/3db57c8b643fba8302ed39d8cf0f4ddb.svg
Guanyu Feng
user
jiguanglizipao
66d1255a3b8f08e1b2de17cd
Da Yin
66d1255a3b8f08e1b2de17ce
Zihan Wang
66d1255a3b8f08e1b2de17cf
Ji Qi
claimed_verified
2025-07-02T08:24:31.501Z
6864b9f90a269bace8c92164
https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/zSeWHZRCZtzZ13CzFrr5u.png
Ji Qi
user
miracle11121
66d1255a3b8f08e1b2de17d0
Xixuan Song
admin_assigned
2024-08-30T07:50:05.317Z
63f36b504745321de3510823
https://cdn-avatars.huggingface.co/v1/production/uploads/1679311624745-63f36b504745321de3510823.jpeg
Song XiXuan
user
DrSong
66d1255a3b8f08e1b2de17d1
Peng Zhang
66d1255a3b8f08e1b2de17d2
Debing Liu
66d1255a3b8f08e1b2de17d3
Bin Xu
66d1255a3b8f08e1b2de17d4
Juanzi Li
admin_assigned
2024-08-30T07:49:11.275Z
65df8cbc2705d9672f55d1aa
/avatars/63e46f15bb76bd9d4508fd0f54f39829.svg
Juanzi Li
user
juanli
66d1255a3b8f08e1b2de17d5
Yuxiao Dong
admin_assigned
2024-08-30T07:49:02.883Z
640e73bdfdeaae1390857b62
/avatars/cd6779e30f716002a7838ed93d5c0754.svg
Yuxiao Dong
user
yuxiaod
66d1255a3b8f08e1b2de17d6
Jie Tang
admin_assigned
2024-08-30T07:48:54.483Z
640dff05474aa6f89556677e
/avatars/1b4591c7322d649c797b3125148f1915.svg
Jie Tang
user
jerytang
CogVLM2: Visual Language Models for Image and Video Understanding
Beginning with VisualGLM and CogVLM, we are continuously exploring VLMs in
pursuit of enhanced vision-language fusion, efficient higher-resolution
architecture, and broader modalities and applications. Here we propose the
CogVLM2 family, a new generation of visual language models for image and video
understanding including CogVLM2, CogVLM2-Video and GLM-4V. As an image
understanding model, CogVLM2 inherits the visual expert architecture with
improved training recipes in both pre-training and post-training stages,
supporting input resolution up to 1344 times 1344 pixels. As a video
understanding model, CogVLM2-Video integrates multi-frame input with timestamps
and proposes automated temporal grounding data construction. Notably, CogVLM2
family has achieved state-of-the-art results on benchmarks like MMBench,
MM-Vet, TextVQA, MVBench and VCGBench. All models are open-sourced in
https://github.com/THUDM/CogVLM2 and https://github.com/THUDM/GLM-4,
contributing to the advancement of the field.
The CogVLM2 family of visual language models, including CogVLM2, CogVLM2-Video, and GLM-4V, advances image and video understanding with enhanced architectures and training methods.
visual language models CogVLM2 CogVLM2-Video GLM-4V visual expert architecture pre-training post-training input resolution multi-frame input timestamps automated temporal grounding MMBench MM-Vet TextVQA MVBench VCGBench