StreamBridge: Turning Your Offline Video Large Language Model into a
  Proactive Streaming Assistant
We present StreamBridge, a simple yet effective framework that seamlessly
transforms offline Video-LLMs into streaming-capable models. It addresses two
fundamental challenges in adapting existing models into online scenarios: (1)
limited capability for multi-turn real-time understanding, and (2) lack of
proactive response mechanisms. Specifically, StreamBridge incorporates (1) a
memory buffer combined with a round-decayed compression strategy, supporting
long-context multi-turn interactions, and (2) a decoupled, lightweight
activation model that can be effortlessly integrated into existing Video-LLMs,
enabling continuous proactive responses. To further support StreamBridge, we
construct Stream-IT, a large-scale dataset tailored for streaming video
understanding, featuring interleaved video-text sequences and diverse
instruction formats. Extensive experiments show that StreamBridge significantly
improves the streaming understanding capabilities of offline Video-LLMs across
various tasks, outperforming even proprietary models such as GPT-4o and Gemini
1.5 Pro. Simultaneously, it achieves competitive or superior performance on
standard video understanding benchmarks.
681d95b5c7ae5f65b0e55ff9
Haibo Wang
claimed_verified
2025-05-09T07:21:20.829Z
63fee47352441fe3e87b5088
/avatars/c1df1899e3925aa6fdfc8ee0049fa8a7.svg
WANG HAIBO
user
WHB139426
681d95b5c7ae5f65b0e55ffa
Bo Feng
681d95b5c7ae5f65b0e55ffb
Zhengfeng Lai
admin_assigned
2025-05-09T09:00:45.264Z
66b5295f83425904fa7a1a6a
/avatars/a35568fb933ceef7451bd88fb3d5ab17.svg
Zhengfeng Lai
user
jefflai
681d95b5c7ae5f65b0e55ffc
Mingze Xu
681d95b5c7ae5f65b0e55ffd
Shiyu Li
admin_assigned
2025-05-09T09:01:08.366Z
67fa856547b40f55b7ff3ce5
/avatars/745937497772e9b533ba7940d758d30d.svg
Shiyu Li
user
ShiyuLi
681d95b5c7ae5f65b0e55ffe
Weifeng Ge
681d95b5c7ae5f65b0e55fff
Afshin Dehghan
admin_assigned
2025-05-09T09:01:21.716Z
66fc2377516eaf950d4b8209
https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/mcUxUxXy18Gv9KvCW23s0.png
Afshin Dehghan
user
afshindn
681d95b5c7ae5f65b0e56000
Meng Cao
681d95b5c7ae5f65b0e56001
Ping Huang
StreamBridge: Turning Your Offline Video Large Language Model into a
  Proactive Streaming Assistant
We present StreamBridge, a simple yet effective framework that seamlessly
transforms offline Video-LLMs into streaming-capable models. It addresses two
fundamental challenges in adapting existing models into online scenarios: (1)
limited capability for multi-turn real-time understanding, and (2) lack of
proactive response mechanisms. Specifically, StreamBridge incorporates (1) a
memory buffer combined with a round-decayed compression strategy, supporting
long-context multi-turn interactions, and (2) a decoupled, lightweight
activation model that can be effortlessly integrated into existing Video-LLMs,
enabling continuous proactive responses. To further support StreamBridge, we
construct Stream-IT, a large-scale dataset tailored for streaming video
understanding, featuring interleaved video-text sequences and diverse
instruction formats. Extensive experiments show that StreamBridge significantly
improves the streaming understanding capabilities of offline Video-LLMs across
various tasks, outperforming even proprietary models such as GPT-4o and Gemini
1.5 Pro. Simultaneously, it achieves competitive or superior performance on
standard video understanding benchmarks.
StreamBridge is a framework that enhances offline Video-LLMs for streaming capabilities through a memory buffer with compression and a proactive response model, demonstrating superior performance on video understanding tasks.
Video-LLMs streaming-capable models multi-turn real-time understanding round-decayed compression strategy proactive response mechanisms interleaved video-text sequences Stream-IT dataset