研究人员开发了CHASMBrain，一种用于将图像编码为fMRI数据的新分层框架。该模型使用双流Mamba架构来区分全局语义信息和局部空间细节，模仿了人类视觉皮层。在Natural Scenes Dataset上的实验表明，CHASMBrain的表现优于现有方法，实现了0.429的皮尔逊相关系数和0.261的均方误差。进一步分析表明，该模型的patch流与早期视觉处理相关，而CLS流为更高级别的大脑区域提供了更广泛的语义背景。 AI
影响 这项研究通过将AI模型与人类大脑活动联系起来，提供了一种理解视觉表征的新方法，有望推动这两个领域的发展。
排序理由 详细介绍新模型架构和实验结果的学术论文。
AI 生成摘要 · Google Gemini · 来自 3 个来源。 我们如何撰写摘要 →
arXiv:2606.04772v1 Announce Type: cross Abstract: Understanding the relationship between deep visual representations and the human visual system is a fundamental challenge in computational neuroscience. While modern vision models achieve strong performance in image recognition, t…
Understanding the relationship between deep visual representations and the human visual system is a fundamental challenge in computational neuroscience. While modern vision models achieve strong performance in image recognition, their correspondence with the hierarchical organiza…
Understanding the relationship between deep visual representations and the human visual system is a fundamental challenge in computational neuroscience. While modern vision models achieve strong performance in image recognition, their correspondence with the hierarchical organiza…