Google-led team introduces StreamVibe‑VL, a video agent trained to decide when to speak up
Researchers from Google, Stanford, Oxford and U.S. universities published StreamVibe, a system and benchmark for proactive video assistants. They trained StreamVibe‑VL (based on Alibaba's Qwen3.5‑9B) with a memory module and reinforcement learning to decide each second whether to speak; tests on ~4,100 examples from 183+ hours show timing and quality gains (≈10.7%) and additional benefits from the memory system (≈12.3%), but models still struggle with long interactions and compounding errors, and Google’s proprietary Gemini 3.8 Flash outperforms on several tests.