HiDe framework boosts MLLM performance on high-res images

Researchers have developed a new training-free framework called HiDe to improve the performance of Multimodal Large Language Models (MLLMs) on high-resolution images. HiDe addresses background interference rather than object size as the primary cause of performance degradation. The framework uses Token-wise Attention Decoupling (TAD) and Layout-Preserving Decoupling (LPD) to isolate key visual information and eliminate distracting background elements. This approach has achieved state-of-the-art results on benchmarks like V*Bench, HRBench4K, and HRBench8K, significantly boosting models such as Qwen2.5-VL 7B and InternVL3 8B. AI

IMPACT Enhances MLLM capabilities for high-resolution image analysis, potentially improving applications in fields like medical imaging and satellite imagery.

RANK_REASON The cluster contains a research paper detailing a new framework and benchmark results. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.CV →

• HiDe
• HRBench4K
• HRBench8K
• InternVL3 8B
• Multimodal Large Language Models
• Qwen2.5-VL 7B
• V*Bench
• Xianjie Liu

• paper
• model release

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →