Researchers have developed OmniTrace, a novel framework designed to attribute generated text in omni-modal large language models to specific parts of the input data. This method operates during the generation pass, utilizing late-layer attention to identify source units like text chunks, images, or audio/video segments without requiring additional forward passes or modality-specific tuning. OmniTrace demonstrates significant efficiency and accuracy, recovering a high percentage of attribution information compared to traditional leave-one-out methods and showing strong agreement with human-identified evidence. AI
IMPACT Enables more transparent and verifiable outputs from omni-modal LLMs, crucial for applications requiring evidence-based reasoning.
RANK_REASON The cluster contains an academic paper detailing a new framework for LLMs. [lever_c_demoted from research: ic=1 ai=1.0]
- arXiv
- Hugging Face
- MiniCPM-o 4.5
- Omni-modal LLMs
- OmniTrace
- Qianqi Yan
- Qwen2.5-Omni-7B
- Qwen3-Omni-30B
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →