UniReason-Med: A Shared Grounded Reasoning Interface for 2D-to-3D Transfer in Medical VQA
Researchers have developed UniReason-Med, a novel framework designed to enhance 3D medical visual question answering (VQA) by leveraging supervision from 2D medical images. This system utilizes a shared reasoning interface that can process both 2D images and serialized 3D volumes, generating interleaved textual reasoning and localized visual evidence. The framework was trained on UniMed-CoT, a 220K sample instruction-tuning dataset, and demonstrated that joint 2D and 3D grounded supervision significantly improves 3D reasoning capabilities compared to 3D-only training. AI
IMPACT This research could lead to more accurate diagnostic tools by improving the ability of AI to reason about 3D medical data.