A new audit methodology called VideoRouteAudit has been developed to dissect the performance gains in long-video question answering models. The audit found that common frame selection strategies offer minimal improvement over uniform sampling, with larger gains attributed to evidence injection and model swapping rather than sophisticated frame selection. The research also highlighted the impact of automatic speech recognition (ASR) transcripts on model accuracy, noting that their placement relative to the question can significantly alter results. AI
IMPACT Challenges current assumptions about frame selection in video QA, suggesting a shift in focus towards evidence injection and model architectures.
RANK_REASON Academic paper detailing a new audit methodology and its findings on video QA models. [lever_c_demoted from research: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →