New framework TimeProVe enhances long video temporal reasoning efficiency

Researchers have developed TimeProVe, a novel framework designed to improve the efficiency of temporal reasoning in long videos, particularly for activities of daily living. This approach uses lightweight modules to propose potential answer-evidence hypotheses before engaging a more computationally expensive vision-language model (VLM) for targeted verification. To evaluate its effectiveness, the team also introduced OpenTSUBench (OTB), a new benchmark for assessing temporal reasoning in real-world scenarios. Experiments demonstrated that TimeProVe significantly reduces VLM calls and inference costs while achieving state-of-the-art results on OTB and competitive performance on other benchmarks like Charades-STA. AI

IMPACT This framework could significantly reduce the computational cost of analyzing long videos, making advanced temporal reasoning more accessible for various applications.

RANK_REASON The cluster describes a new academic paper proposing a novel framework and benchmark for video temporal reasoning. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.CV →

• Ace Robot
• Charades-STA
• LVQA
• OpenTSUBench
• Otley and Ilkley Joint Line
• TimeProVe
• Vision--Language Models

• paper
• other

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →