Researchers have introduced a new task called responsibility distribution estimation, specifically for ego-view accident videos. This task aims to predict the percentage of responsibility assigned to each agent involved in an accident based on the driver's perspective. The team developed an LLM-assisted annotation pipeline and fine-tuned multimodal large language models using various inputs like raw frames, enhanced segmentation, and textual descriptions. Their experiments show that multimodal LLMs can effectively handle this complex reasoning task, offering a new direction for socially and legally relevant multimodal analysis beyond simple accident classification. AI
IMPACT This research could lead to more nuanced AI analysis of real-world events, potentially aiding in accident reconstruction and legal proceedings.
RANK_REASON Academic paper introducing a new task and methodology. [lever_c_demoted from research: ic=1 ai=1.0]
- arXiv
- Ego-View Accident Videos
- LLM-assisted responsibility annotation pipeline
- Multimodal Large Language Models
- Responsibility Distribution Estimation
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →