PulseAugur
实时 09:50:58
English(EN) Detecting Clinical Hallucinations in LVLMs via Counterfactual Visual Grounding Uncertainty

新研究通过先进的检测方法解决 LLM 和 VLM 幻觉问题

研究人员正在开发新的方法来对抗大型语言模型 (LLM) 和视觉语言模型 (VLM) 中的幻觉。一种名为“不确定时验证”的方法,通过跨模型一致性检查来提高幻觉检测的准确性,同时降低计算成本。另一种方法 CORTEX,通过比较检索文档的有无对内部模型表示的差异,专注于检索增强生成 (RAG) 中的 token 级检测。对于 VLM,ViPSyContext-aware Attention Intervention (CAI) 等技术旨在通过更好地使模型输出与图像内容对齐并减少对语言先验的依赖来增强视觉保真度。 AI

影响 幻觉检测和缓解方面的进步对于提高 LLM 和 VLM 在敏感应用中的可靠性和可信度至关重要。

排序理由 多篇学术论文发表在 arXiv 上,详细介绍了检测和缓解 LLM、VLM 和 RAG 系统中幻觉的新方法。

在 arXiv cs.CL 阅读 →

AI 生成摘要 · Google Gemini · 来自 13 个来源。 我们如何撰写摘要 →

新研究通过先进的检测方法解决 LLM 和 VLM 幻觉问题

报道来源 [13]

  1. arXiv cs.CL TIER_1 English(EN) · \'Ad\'am Kov\'acs, Bowei He, Xue Liu, Istv\'an Boros, Szilveszter T\'oth, G\'abor Recski ·

    超越文档接地:代码、工具输出和文档的跨度级幻觉检测

    arXiv:2607.00895v1 Announce Type: new Abstract: Hallucination detection for retrieval-augmented generation (RAG) is usually evaluated on natural-language document evidence. However, grounded generation systems increasingly rely on structured inputs: source code, developer-tool ou…

  2. arXiv cs.CL TIER_1 English(EN) · Vijay Vankadaru, Asha Matthews, Tanya Roosta, Peyman Passban ·

    可读但不可控:医疗大模型幻觉的神经元级别证据

    arXiv:2607.00158v1 Announce Type: new Abstract: Hallucination remains one of the central obstacles to deploying medical LLMs. Yet, even when hallucination can be detected, it is still unclear whether the internal representations associated with it can be used for control rather t…

  3. arXiv cs.CL TIER_1 English(EN) · Gábor Recski ·

    超越文档溯源:代码、工具输出和文档的跨度级幻觉检测

    Hallucination detection for retrieval-augmented generation (RAG) is usually evaluated on natural-language document evidence. However, grounded generation systems increasingly rely on structured inputs: source code, developer-tool output, markdown documents, tables, and repository…

  4. arXiv cs.CL TIER_1 English(EN) · Kazuaki Furumai, Shuichiro Haruta, Kazunori Matsumoto, Daisuke Kamisaka ·

    CORTEX: 通过比较内部表征在 RAG 中进行令牌级幻觉检测

    arXiv:2606.31033v1 Announce Type: new Abstract: In this paper, we propose CORTEX, a token-level hallucination detection method for Retrieval-Augmented Generation (RAG). In long-form RAG outputs, hallucinations often arise in localized spans rather than throughout an entire respon…

  5. arXiv cs.AI TIER_1 English(EN) · Yihao Xue, Kristjan Greenewald, Youssef Mroueh, Baharan Mirzasoleiman ·

    不确定时验证:超越黑盒幻觉检测中的自洽性

    arXiv:2502.15845v2 Announce Type: replace-cross Abstract: Large Language Models (LLMs) often hallucinate, limiting their reliability in sensitive applications. In black-box settings, several self-consistency-based techniques have been proposed for hallucination detection. We empi…

  6. arXiv cs.CL TIER_1 English(EN) · Peyman Passban ·

    可读但不可控:医学大语言模型幻觉的神经元级别证据

    Hallucination remains one of the central obstacles to deploying medical LLMs. Yet, even when hallucination can be detected, it is still unclear whether the internal representations associated with it can be used for control rather than detection alone. Using four open-source mode…

  7. arXiv cs.CL TIER_1 English(EN) · Xiao Song, Haonan Qin, Zhaoxu Zhang, Jiong Zhang, Yuqi Fang, Caifeng Shan ·

    通过反事实视觉基础不确定性检测 LVLM 中的临床幻觉

    arXiv:2606.28520v1 Announce Type: cross Abstract: Large vision-language models (LVLMs) are increasingly used for clinical image understanding, yet they remain vulnerable to \emph{hallucinations}--producing textual findings or attributes not supported by the image. We present a vi…

  8. arXiv cs.LG TIER_1 English(EN) · Yunhun Nam, Jongheon Jeong ·

    面向视觉驱动的偏好合成以减轻VLMs中的幻觉

    arXiv:2606.28401v1 Announce Type: cross Abstract: Vision-Language Models (VLMs) have shown strong performance in visual understanding, yet they still suffer from hallucinations, generating content that is not grounded in the image. Preference alignment is a promising approach to …

  9. arXiv cs.CL TIER_1 English(EN) · Daisuke Kamisaka ·

    CORTEX: 通过比较内部表征实现RAG中的令牌级幻觉检测

    In this paper, we propose CORTEX, a token-level hallucination detection method for Retrieval-Augmented Generation (RAG). In long-form RAG outputs, hallucinations often arise in localized spans rather than throughout an entire response. CORTEX therefore identifies ungrounded conte…

  10. arXiv cs.CV TIER_1 English(EN) · Ying-Cong Chen ·

    无处可藏:通过背景控制对基准测试视频幻觉

    We introduce VidPair-Halluc, a new benchmark for evaluating video hallucination in large video models (LVMs) under rigorous and controlled conditions. Unlike previous benchmarks that primarily rely on text-based perturbations or adversarial questions while neglecting the consiste…

  11. arXiv cs.CV TIER_1 English(EN) · Yuqing Lei, Wenbo Lyu, Yingjun Du, Xiantong Zhen, Cees G. M. Snoek, Ling Shao ·

    仅在需要时查看:上下文感知注意力干预以减轻 LVLM 中的幻觉

    arXiv:2606.29847v1 Announce Type: new Abstract: Large Vision-Language Models (LVLMs) excel at multimodal tasks but remain prone to object hallucinations. Prior training-free remedies often uniformly strengthen visual signals, which may also amplify irrelevant regions and introduc…

  12. arXiv cs.CV TIER_1 English(EN) · Xin Zou, Haolin Deng, Yibo Yan, Shuliang Liu, Zhiwei Jin, Chen Chen, Haonan Lu, Xuming Hu ·

    更清晰的视野,更少的谎言:面向多模态幻觉缓解的定向拾取偏好优化

    arXiv:2606.29805v1 Announce Type: new Abstract: Multimodal Large Language Models (MLLMs) are prone to hallucination as their generation preferences are insufficiently calibrated to visual evidence, causing them to fall back on linguistic priors, rather than faithful grounding. In…

  13. dev.to — LLM tag TIER_1 English(EN) · Sid Probstein ·

    让 RAG 承认其猜测:基于来源的幻觉检查

    <p>The failure mode that scares me most in RAG isn't a wrong answer. It's a confident wrong answer with three citations that don't actually say what the answer claims.</p> <p>So in SWIRL 5 I stopped trusting the model to police itself and added a check that runs <em>after</em> ge…