NeuroQA: A Large-Scale Image-Grounded Benchmark for 3D Brain MRI Understanding
Researchers have introduced NeuroQA, a new benchmark designed to evaluate visual question answering capabilities specifically for 3D brain MRI scans. This benchmark includes over 56,000 question-answer pairs derived from more than 12,000 subjects, covering a wide age range and five major clinical areas. NeuroQA aims to overcome limitations of previous medical VQA efforts by utilizing full 3D volumes and implementing strategies to prevent text-only shortcuts, with initial evaluations showing current models struggle to surpass a baseline accuracy. AI
IMPACT Establishes a new standard for AI's ability to interpret complex 3D medical imaging, potentially accelerating diagnostic AI development.