STAR framework boosts few-shot action recognition with LLM-guided temporal learning

Researchers have developed a new framework called STAR (Semantic-Temporal Adaptive Representation Learning) to improve few-shot action recognition in videos. This approach addresses issues of semantic-temporal misalignment and inadequate modeling of temporal dynamics by integrating a Temporal Semantic Attention mechanism for fine-grained consistency and a Semantic Temporal Prototype Refiner that leverages Mamba blocks. The framework also utilizes temporally dependent class descriptors from large language models to provide long-range semantic guidance, demonstrating significant gains on multiple benchmarks. AI

影响 Enhances video understanding capabilities, potentially improving applications in surveillance, robotics, and content analysis.

排序理由 Academic paper detailing a new framework for few-shot action recognition. [lever_c_demoted from research: ic=1 ai=1.0]

在 arXiv cs.CV 阅读 →

• HMDB51
• Mamba
• SSv2-Full
• SSv2-Small
• STAR

• 论文
• 其他

AI 生成摘要 · Google Gemini · 来自 1 个来源。 我们如何撰写摘要 →