Researchers have introduced a new task called Grounded Human-Attributed Description and Activity Recognition (GHADAR) for analyzing videos. This task requires generating descriptions for every person in a video, including their characteristics and activities, along with their location. To support this, a new dataset was created from AVA-Actions, featuring open-set captions for person descriptions and activities. A novel method is also proposed that constrains cross-attention masks in Vision-Language Models (VLMs) during training to improve performance. The study also highlights limitations in current evaluation metrics and proposes a new VLM-based evaluation schema. AI
IMPACT Establishes a new benchmark and methodology for detailed video person analysis, potentially improving applications in surveillance and content moderation.
RANK_REASON The cluster contains a research paper detailing a new task, dataset, and method for video analysis. [lever_c_demoted from research: ic=1 ai=1.0]
- alphaXiv
- arXiv
- AVA-Actions
- CatalyzeX
- DagsHub
- GHADAR
- Gotit.pub
- Hugging Face
- ScienceCast
- Vision--Language Models
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →