研究人员开发了PEEK，一种从视频中选择关键帧以生成字幕的高效方法。该技术将知识从大型教师模型蒸馏到小型模型中，使其能够以最小的计算开销识别最相关的帧。PEEK的性能优于现有方法，尤其是在使用少量帧时，并且与其他自适应采样方法相比，显著减少了处理时间。 AI
影响 通过优化帧选择来提高视频字幕模型的效率。
排序理由 该集群包含一篇详细介绍视频处理新方法的学术论文。
在 Hugging Face Daily Papers 阅读 →
AI 生成摘要 · Google Gemini · 来自 2 个来源。 我们如何撰写摘要 →
PEEK is an efficient dynamic frame sampling method that distills caption-conditioned frame relevance rankings from a teacher model into a lightweight temporal model, outperforming state-of-the-art methods in video captioning while maintaining computational efficiency.
arXiv:2605.31029v1 Announce Type: new Abstract: Video-language models can process only a limited number of frames, making frame selection a key bottleneck for efficient video captioning. Most captioning pipelines still rely on uniform sampling, which is computationally cheap but …