PulseAugur
EN
LIVE 07:58:20

New multimodal model maps brain functions onto single contiguous surface

Researchers have developed Topo-Omni, a novel deep topographic multimodal model that maps visual, auditory, and language processing onto a single contiguous surface. This model, fine-tuned from a pretrained foundation model with a spatial smoothness objective, demonstrates that a unified spatial principle can organize representations across different modalities and processing stages. The model's clusters align with human neuroimaging data, and selectively activating or suppressing these clusters can bias or impair perception, mirroring findings from human intervention studies. Topo-Omni was also used to identify new in-silico clusters, which were subsequently validated in human data, offering testable hypotheses about cortical organization. AI

IMPACT This research offers a new computational framework for understanding brain organization and generating testable hypotheses about neural representations.

RANK_REASON The cluster contains a research paper detailing a new multimodal model for understanding brain organization. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.LG →

AI-generated summary · Google Gemini · from 2 sources. How we write summaries →

COVERAGE [2]

  1. arXiv cs.LG TIER_1 English(EN) · Badr AlKhamissi, Johannes Mehrer, Lara Marinov, Ahmed Abdelaal, Abdulkadir Gokce, Martin Schrimpf ·

    Discovering Functionally Selective Brain Regions with a Deep Topographic Multimodal Model

    arXiv:2606.09770v1 Announce Type: cross Abstract: Nearby neurons in cortex share similar response profiles, producing systematic spatial organization across sensory and cognitive systems. Recent topographic models reproduce aspects of this structure but remain unimodal and spatia…

  2. arXiv cs.LG TIER_1 English(EN) · Martin Schrimpf ·

    Discovering Functionally Selective Brain Regions with a Deep Topographic Multimodal Model

    Nearby neurons in cortex share similar response profiles, producing systematic spatial organization across sensory and cognitive systems. Recent topographic models reproduce aspects of this structure but remain unimodal and spatially constrain each layer separately, yielding frag…