PulseAugur
中
实时 09:33:56
English(EN) Beyond Retrieval: Progressive Latent Memory Evolution for Streaming Video Understanding

新AI模型通过高效内存管理增强流视频理解 · 跟踪7个来源

研究人员正在开发用于流视频理解的新方法,重点关注多模态大语言模型(MLLMs)的高效内存管理。LatentStream和ShallowStream提出了超越简单存储和检索内存范式的新颖框架。LatentStream将历史证据内化为演化的潜在记忆,而ShallowStream使用浅层模型来高效编码帧和检索索引。其他方法,如CoFiE和StreamScout,也旨在通过解耦证据选择和自适应地决定何时更深入地处理帧来提高效率,同时在各种视频理解基准上取得最先进的结果。 AI

影响 这些在MLLMs高效内存管理方面的进步,通过实现更快、更准确的视频分析,有望显著改善自动驾驶和监控等现实世界应用。

排序理由 多篇研究论文介绍了流视频理解的新颖方法。

在 Hugging Face Daily Papers 阅读 →

AI 生成摘要 · Google Gemini · 来自 8 个来源。 我们如何撰写摘要 →

新AI模型通过高效内存管理增强流视频理解 · 跟踪7个来源

本文如何被排名

Signal score
0 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Research
多篇研究论文介绍了流视频理解的新颖方法。
Source corroboration
8 independent sources
Strong cross-source corroboration — multiple independent publishers covered this within the clustering window.
Topics
paper, model release
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
77 days old
Aged out of breaking-news scoring windows; ranking reflects the durable signal from the full source set.

完整方法见我们的编辑标准。

报道来源 [8]

  1. Hugging Face Daily Papers TIER_1 English(EN) ·

    超越检索:渐进式潜在记忆演化用于流媒体视频理解

    Streaming video understanding requires multimodal large language models (MLLMs) to process continuous visual inputs and respond to user queries under strict causality and bounded memory. Existing approaches typically compress historical observations into an external memory bank a…

  2. arXiv cs.CL TIER_1 English(EN) · Jitai Hao, Ke Yang, Qiang Huang, Jun Yu ·

    ShallowStream:先浅层索引再深层回答,用于流式视频理解

    arXiv:2609.02780v1 Announce Type: cross Abstract: Streaming video understanding is a critical capability for real-world applications, including embodied intelligence, autonomous driving, industrial monitoring, surveillance and early warning, and wearable assistants. However, proc…

  3. Hugging Face Daily Papers TIER_1 English(EN) ·

    超越检索:渐进式潜在记忆演化用于流媒体视频理解

    LatentStream introduces a progressive latent working memory framework that internalizes streaming visual evidence into compact evolving tokens for continuous reasoning.

  4. arXiv cs.CV TIER_1 English(EN) · Jing Jiang, Yiran Ling, Ruonan Li, Dimitrios Stamoulis, Jie Liu ·

    CoFiE:粗粒度到细粒度证据选择,实现高效流媒体视频理解

    arXiv:2609.03675v1 Announce Type: new Abstract: Streaming video understanding requires Vision Language Models (VLLMs) to process growing video streams and answer user questions under tight latency constraints. Existing methods improve efficiency through token pruning and memory-b…

  5. arXiv cs.CV TIER_1 English(EN) · Hongyu Qu, Guangming Yao, Ling Xing, Xiaobin Hu, Rongxing Ding, Guibin Zhang, Fan Zhang, Yi Yuan, Xiangbo Shu, Shuicheng Yan ·

    超越检索:渐进式潜在记忆演化用于流媒体视频理解

    arXiv:2609.04131v1 Announce Type: new Abstract: Streaming video understanding requires multimodal large language models (MLLMs) to process continuous visual inputs and respond to user queries under strict causality and bounded memory. Existing approaches typically compress histor…

  6. arXiv cs.CV TIER_1 English(EN) · Ce Zhang, Jing Bi, Jinxi He, Jianshu Zhang, Jingyang Lin, Yunzhong Xiao, Minghao Fu, Yaqi Xie, Zhentao Xie, Weicong Chen, Katia Sycara, Ming Zhou ·

    StreamScout:学习何时深入研究以理解流媒体视频

    arXiv:2609.00291v1 Announce Type: new Abstract: Streaming video understanding requires answering questions that arrive at arbitrary moments over an unbounded video stream. Existing systems primarily focus on what to retain in a bounded memory, yet access that memory using the sam…

  7. arXiv cs.CV TIER_1 English(EN) · Xinru Jiang, Lin Zhao, Xi Xiao, Yunbei Zhang, Janet Wang, Chenrui Ma, Haolin Li, Yanzhi Wang, Yifan Gong, Octavia Camps ·

    面向流媒体视频理解的动态中心辐射式内存

    arXiv:2608.30294v1 Announce Type: new Abstract: Streaming video understanding requires answering questions at arbitrary times over a continuously growing visual stream. The central challenge is to compactly remember long-range history while effectively retrieving question-relevan…

  8. arXiv cs.CV TIER_1 English(EN) · Yuxin Liu, Peiqin Zhuang, Yali Wang ·

    StreamEMS:面向视觉语言模型的自演化记忆机制流式视频理解

    arXiv:2608.27881v1 Announce Type: new Abstract: Recently, many streaming video understanding methods have been proposed by constructing an external memory to store historical data for computational reduction. Most methods focus on optimizing the injection procedure of current dat…