PulseAugur
EN
LIVE 09:21:37

Two new methods tackle Video-LLM token compression for efficiency

Two new research papers propose novel methods for compressing video tokens in Video Large Language Models (Video-LLMs) to improve efficiency. The first paper introduces NovaCov, a set-wise token compressor designed for streaming video that uses a historical reference bank and a dual-branch submodular coverage objective to retain representative content while reducing LLM prefilling latency by 46%. The second paper presents ONCE, a framework that learns a frequency-aware global codebook offline and reuses it for lightweight online compression, significantly reducing per-video computation and inference latency. AI

IMPACT These methods aim to reduce inference latency and computational costs for Video-LLMs, potentially enabling wider adoption and more efficient processing of video content.

RANK_REASON Two academic papers published on arXiv introducing novel methods for video token compression in Video-LLMs.

Read on arXiv cs.CV →

AI-generated summary · Google Gemini · from 2 sources. How we write summaries →

Two new methods tackle Video-LLM token compression for efficiency

COVERAGE [2]

  1. arXiv cs.CV TIER_1 English(EN) · Moxu Duan, Jingwen Fu, Yuwang Wang ·

    Think in Sets for Streaming Video Token Compression

    arXiv:2608.01169v1 Announce Type: new Abstract: Streaming VideoLLMs process frames causally while visual tokens grow continuously, making compression essential for controlling prefilling latency and memory. Existing training-free methods independently rank tokens, ignoring margin…

  2. arXiv cs.CV TIER_1 English(EN) · Jiayang He, Tianling Xu, Diancheng Kang, Huaide Jiang, Junyan Bai, Shaoming Zheng, Xuan Song ·

    Rethinking Video Token Compression with a Global Codebook: Learning Once, Compressing Everywhere

    arXiv:2608.01271v1 Announce Type: new Abstract: Video large language models (Video-LLMs) represent videos as dense sequences of visual tokens, whose length grows with the temporal and spatial extent of the input. These tokens often contain substantial redundancy arising from repe…