PulseAugur
中
实时 19:31:00
English(EN) Beyond Calibration: Temporal LLM Confidence Assessment Across Languages and Local Settings

LLM置信度信号在本地知识上退化,幻觉持续存在

研究人员调查了大型语言模型(LLM)在问题解决的不同时间阶段的置信度信号,区分了解决前“已知感”(FOK)和解决后“学习判断”(JOL)。他们的发现表明,虽然解决后置信度通常提供更好的认知对齐,但解决前置信度成本较低且显示出一定的校准性。研究还发现,置信度校准通过翻译在英语和马拉地语之间转移良好,但对于本地特有的马拉地语知识则显著退化,这表明仅靠语言转移不足以保证区域信息的准确性。此外,即使在生成幻觉响应时,LLM也倾向于保持高置信度,这表明其自我评估能力存在局限性。 AI

影响 强调了LLM自我评估的局限性以及处理特定区域知识的必要性。

排序理由 在arXiv上发表的关于LLM置信度评估的学术论文。

在 Hugging Face Daily Papers 阅读 →

AI 生成摘要 · Google Gemini · 来自 2 个来源。 我们如何撰写摘要 →

LLM置信度信号在本地知识上退化,幻觉持续存在

本文如何被排名

Signal score
0 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Research
在arXiv上发表的关于LLM置信度评估的学术论文。
Source corroboration
2 independent sources
Multiple independent publishers reporting the same story raises confidence that it's real and newsworthy.
Topics
paper, safety
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
33 days old
Aged out of breaking-news scoring windows; ranking reflects the durable signal from the full source set.

完整方法见我们的编辑标准。

报道来源 [2]

  1. arXiv cs.AI TIER_1 English(EN) · Sahil Kale ·

    超越校准:跨语言和本地设置下的时间LLM置信度评估

    arXiv:2610.27702v1 Announce Type: cross Abstract: Large language models are expected to estimate their own uncertainty, with confidence signals used to guide retrieval, adaptive compute allocation, routing, and selective abstention. We investigate whether confidence signals measu…

  2. Hugging Face Daily Papers TIER_1 English(EN) ·

    超越校准:跨语言和本地设置下的时间LLM置信度评估

    Large language models are expected to estimate their own uncertainty, with confidence signals used to guide retrieval, adaptive compute allocation, routing, and selective abstention. We investigate whether confidence signals measured at different temporal stages of problem solvin…