PulseAugur
实时 16:33:19
English(EN) What Should a Streaming Video Model Remember?

SelectStream 框架通过选择性内存分配增强流媒体视频 AI

研究人员开发了 SelectStream,一个用于流媒体视频理解模型的新颖框架,该框架选择性地分配内存,以解决在固定计算预算下处理连续视频数据的挑战。与之前不加区分地注入历史记录的方法不同,SelectStream 使用条件查询的证据预算来优先考虑当前场景感知。该框架采用由惊喜驱动的窗口化、保留优先级的巩固以及图推理来管理内存,在 StreamingBenchOVO-Bench 等基准测试中取得了强劲的性能。 AI

影响 提高了处理连续视频数据的 AI 模型的效率和性能。

排序理由 该集群包含一篇详细介绍 AI 模型新框架的学术论文。

在 arXiv cs.CV 阅读 →

AI 生成摘要 · Google Gemini · 来自 2 个来源。 我们如何撰写摘要 →

报道来源 [2]

  1. arXiv cs.AI TIER_1 English(EN) · Haonan Ge, Yiwei Wang, Hang Wu, Yujun Cai ·

    What Should a Streaming Video Model Remember?

    arXiv:2606.16353v1 Announce Type: cross Abstract: Streaming video understanding models must answer queries at any moment during an ongoing stream, using only what they have observed so far and under fixed memory and computation budgets. Existing methods address this by adding mem…

  2. arXiv cs.CV TIER_1 English(EN) · Yujun Cai ·

    What Should a Streaming Video Model Remember?

    Streaming video understanding models must answer queries at any moment during an ongoing stream, using only what they have observed so far and under fixed memory and computation budgets. Existing methods address this by adding memory banks, retrieval modules, or visual token comp…