Ruiying Peng

New framework tackles attention dispersion in multimodal LLMs

Researchers have identified a phenomenon called attention dispersion in multimodal large language models (MLLMs) that impairs their reasoning capabilities, particularly in visual question answering tasks. This occurs wh…