New 'Thinking-Once' method improves high-resolution VQA by routing existing evidence

Researchers have developed a new method called Thinking-Once for high-resolution visual question answering (HR-VQA). This technique focuses on efficiently routing evidence that is already present in intermediate layers of multimodal models, rather than repeatedly acquiring new visual inputs through cropping or re-encoding. Thinking-Once reconstructs question-conditioned attention to preserve key entity tokens and context, routing them to later layers without additional visual processing. The method has demonstrated consistent improvements across various base models, notably increasing scores on benchmarks like V$^*$Bench, HRBench-4K, and HRBench-8K while reducing memory usage. AI

IMPACT Enhances efficiency and accuracy in visual question answering tasks by optimizing evidence routing within existing models.

RANK_REASON Research paper detailing a novel method for improving VQA performance. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.CV →

• DeepScan
• HRBench-4K
• HRBench-8K
• HR-VQA
• Qwen2.5-VL-7B
• Thinking-Once
• V$^*Bench
• ZwZ-8B

• paper
• model release

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →