Researchers have developed PI-MLLM, a novel multimodal large language model designed for analyzing emotions evoked by "oddly satisfying videos" (OSVs). These videos, characterized by repetitive motions and ASMR-like sounds, present a unique challenge for emotion analysis due to their reliance on sensory dynamics rather than explicit semantic content. To address this, a new dataset, OSVD, was created with 12,000 clips annotated for viewer emotions under various sensory conditions. PI-MLLM incorporates Modality-Specific Dynamics Alignment (MSDA) and Coalition-Based Audio-Visual Attribution (CAVA) to better predict emotions and provide explanations grounded in visual and acoustic sensory evidence. AI
IMPACT This research could lead to more nuanced AI understanding of human emotional responses to sensory stimuli.
RANK_REASON The item is a research paper detailing a new model and dataset for a specific AI task. [lever_c_demoted from research: ic=1 ai=1.0]
- arXiv
- CAVA
- Coalition-Based Audio-Visual Attribution
- Modality-Specific Dynamics Alignment
- oddly satisfying video
- Oddly Satisfying Video Dataset
- OSVEA
- OSVs
- PI-MLLM
- Video Emotion Analysis
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →