Researchers have developed TOFU, a novel token-based foundation model designed for multi-modal knowledge graph reasoning (MMKGR). This model discretizes structural, visual, and textual data into modality-specific tokens, enabling it to generalize effectively across different knowledge graphs. TOFU utilizes a hierarchical fusion architecture with message-mixing mechanisms to process these tokens and extract transferable features. Experiments across 17 diverse MMKGs demonstrate that TOFU surpasses existing knowledge graph foundation models and MMKGR baselines, particularly on unseen knowledge graphs. AI
IMPACT This research could improve the ability of AI systems to reason across diverse and complex knowledge graphs by better integrating multi-modal data.
RANK_REASON The cluster contains an academic paper detailing a new model and its experimental results. [lever_c_demoted from research: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →