Researchers have introduced HAPACT, a new benchmark and dataset designed to improve the localization of human-centric physical impacts in videos. This benchmark, derived from movie clips, focuses on identifying the temporal and spatial aspects of forceful events affecting the human body. The dataset comprises over 2.8K video-query pairs with more than 20K annotated frames, utilizing viewer-grounded annotation and text-conditioned localization. Initial evaluations using existing video moment retrieval and human-scene contact models indicate that physical impact localization remains a challenging task, highlighting the need for HAPACT to advance research in this area. AI
IMPACT This benchmark could drive advancements in video understanding and physical reasoning for AI systems.
RANK_REASON The cluster contains a research paper introducing a new benchmark and dataset for a specific AI task. [lever_c_demoted from research: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →