研究人员推出SMART框架，旨在通过释放标准单向量嵌入模型中隐藏的多向量能力来增强多模态检索。该方法在推理过程中使用对比训练和后期交互，以提高跨各种模态的性能。SMART可以作为即插即用升级或通过轻量级后期训练应用，提供一种提高检索准确性并优于现有模型的有效方法。 AI
影响 这项研究提供了一种更有效的方法来改进多模态检索，有可能提高依赖于理解和比较不同数据类型的应用程序的性能。
排序理由 该集群包含一篇详细介绍人工智能研究新框架和方法的学术论文。
在 Hugging Face Daily Papers 阅读 →
AI 生成摘要 · Google Gemini · 来自 3 个来源。 我们如何撰写摘要 →
完整方法见我们的编辑标准。
arXiv:2605.24938v1 Announce Type: cross Abstract: Multimodal retrieval relies heavily on single-vector retrievers, which compress rich, sequential token sequences into one single global representation. While efficient, they discard fine-grained, local evidence critical for dense …
Multimodal retrieval relies heavily on single-vector retrievers, which compress rich, sequential token sequences into one single global representation. While efficient, they discard fine-grained, local evidence critical for dense retrieval tasks. Multi-vector approaches were intr…
SMART enhances multimodal retrieval by leveraging latent multi-vector capabilities from single-vector models through contrastive training and late-interaction inference, achieving state-of-the-art performance with reduced computational costs.