MMDocIR

MLLM retrieval heads are sparse, shared across modalities, and optimizable

Researchers have investigated the retrieval heads within multimodal large language models (MLLMs), finding that these heads, responsible for locating relevant information in long inputs, remain sparse and largely shared…