MotionBench: Benchmarking and Improving Fine-grained Video Motion
  Understanding for Vision Language Models
In recent years, vision language models (VLMs) have made significant
advancements in video understanding. However, a crucial capability -
fine-grained motion comprehension - remains under-explored in current
benchmarks. To address this gap, we propose MotionBench, a comprehensive
evaluation benchmark designed to assess the fine-grained motion comprehension
of video understanding models. MotionBench evaluates models' motion-level
perception through six primary categories of motion-oriented question types and
includes data collected from diverse sources, ensuring a broad representation
of real-world video content. Experimental results reveal that existing VLMs
perform poorly in understanding fine-grained motions. To enhance VLM's ability
to perceive fine-grained motion within a limited sequence length of LLM, we
conduct extensive experiments reviewing VLM architectures optimized for video
feature compression and propose a novel and efficient Through-Encoder (TE)
Fusion method. Experiments show that higher frame rate inputs and TE Fusion
yield improvements in motion understanding, yet there is still substantial room
for enhancement. Our benchmark aims to guide and motivate the development of
more capable video understanding models, emphasizing the importance of
fine-grained motion comprehension. Project page: https://motion-bench.github.io .
677dfb5d0310e9426191dd3e
Wenyi Hong
extracted_pending
2025-01-08T04:13:19.132Z
62ecd24cb8764c7738ef2793
/avatars/c1b80b5c55f9d652c1aaac7919e1fa32.svg
Wenyi Hong
user
wenyi
677dfb5d0310e9426191dd3f
Yean Cheng
claimed_verified
2025-01-08T09:44:31.589Z
65acc5afe2a2c8635614de43
/avatars/c5fce792792cc0b52ed7475d72460c58.svg
Yean Cheng
user
LiquidAmmonia
677dfb5d0310e9426191dd40
Zhuoyi Yang
admin_assigned
2025-01-08T13:26:08.664Z
6466d1640ed2f7a8cba87503
/avatars/652746e63dfeb5154ae7d34039d1a485.svg
Zhuoyi Yang
user
zyyangzy
677dfb5d0310e9426191dd41
Weihan Wang
claimed_verified
2025-07-02T12:23:07.129Z
63403c75b8b51e0098d3555c
/avatars/85725280b63788e387fe73319a54164d.svg
王维汉
user
mactavish91
677dfb5d0310e9426191dd42
Lefan Wang
677dfb5d0310e9426191dd43
Xiaotao Gu
claimed_verified
2025-07-02T09:24:59.449Z
6438bca4a5e10f6d58694b47
/avatars/3aeb25fbc73c5cab1265e13d11adfb76.svg
XG
user
xgeric
677dfb5d0310e9426191dd44
Shiyu Huang
admin_assigned
2025-01-08T13:27:03.140Z
6406db5cd684369027166986
https://cdn-avatars.huggingface.co/v1/production/uploads/6406db5cd684369027166986/Zl-orrGcbY0RbfjfKszn1.jpeg
Shiyu Huang
user
ShiyuHuang
677dfb5d0310e9426191dd45
Yuxiao Dong
admin_assigned
2025-01-08T13:27:12.264Z
640e73bdfdeaae1390857b62
/avatars/cd6779e30f716002a7838ed93d5c0754.svg
Yuxiao Dong
user
yuxiaod
677dfb5d0310e9426191dd46
Jie Tang
admin_assigned
2025-01-08T13:27:19.977Z
640dff05474aa6f89556677e
/avatars/1b4591c7322d649c797b3125148f1915.svg
Jie Tang
user
jerytang
MotionBench: Benchmarking and Improving Fine-grained Video Motion
  Understanding for Vision Language Models
In recent years, vision language models (VLMs) have made significant
advancements in video understanding. However, a crucial capability -
fine-grained motion comprehension - remains under-explored in current
benchmarks. To address this gap, we propose MotionBench, a comprehensive
evaluation benchmark designed to assess the fine-grained motion comprehension
of video understanding models. MotionBench evaluates models' motion-level
perception through six primary categories of motion-oriented question types and
includes data collected from diverse sources, ensuring a broad representation
of real-world video content. Experimental results reveal that existing VLMs
perform poorly in understanding fine-grained motions. To enhance VLM's ability
to perceive fine-grained motion within a limited sequence length of LLM, we
conduct extensive experiments reviewing VLM architectures optimized for video
feature compression and propose a novel and efficient Through-Encoder (TE)
Fusion method. Experiments show that higher frame rate inputs and TE Fusion
yield improvements in motion understanding, yet there is still substantial room
for enhancement. Our benchmark aims to guide and motivate the development of
more capable video understanding models, emphasizing the importance of
fine-grained motion comprehension. Project page: https://motion-bench.github.io .
MotionBench evaluates and improves vision language models' fine-grained motion comprehension through redesigned benchmarking and an efficient Through-Encoder Fusion method.
vision language models fine-grained motion comprehension MotionBench motion-oriented question types video feature compression Through-Encoder Fusion method