English(EN) The Calls are Coming from Inside the Model: Investigating Probe-based Detection of Tool-Calling Errors in LLMs

新的探针方法可检测大语言模型工具调用错误

作者 PulseAugur 编辑部 · [1 个来源] · 2026-08-31 04:00

研究人员开发了一种基于探针的方法来检测大型语言模型（LLM）使用外部工具时出现的错误。该技术分析 LLM 的内部状态，以识别不正确的工具调用，即使是标准日志也可能遗漏的错误。该研究在 Berkeley Function Calling Leaderboard 上评估了 18 个 LLM，发现探针的有效性取决于模型大小和训练后方法等因素。探针证明了其能够泛化到新的错误类型，表明其具有在现实世界中部署的潜力。 AI

影响这项研究为提高与外部工具交互的大语言模型的可靠性和安全性提供了一种新方法。

排序理由学术论文，详细介绍了一种评估大语言模型行为的新方法。[lever_c_demoted from research: ic=1 ai=1.0]

在 arXiv cs.CL 阅读 →

AI 生成摘要 · Google Gemini · 来自 1 个来源。我们如何撰写摘要 →

本文如何被排名

Signal score: 13 / 100; Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket: Tool; 学术论文，详细介绍了一种评估大语言模型行为的新方法。[lever_c_demoted from research: ic=1 ai=1.0]
Source corroboration: Single-source cluster; Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics: paper, safety; Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance: High; Clearly on-topic for AI-industry coverage.
Story freshness: Breaking (< 6h); Fresh story with cross-source coverage still developing. Ranking may shift as more sources report.

完整方法见我们的编辑标准。

报道来源 [1]

arXiv cs.CL TIER_1 English(EN) · Eric Yeats, Brendan Kennedy, Loc Truong, John Buckheit, Jung Lee, Jesse Friedbaum, John Emanuello, Henry Kvinge · 2026-08-31 04:00

模型内部的呼叫：调查 LLM 中基于探针的工具调用错误检测

arXiv:2608.27750v1 Announce Type: cross Abstract: The hidden states of large language models (LLMs) are known to capture rich information relating to model knowledge and behavior that can be hard to extract from examination of input and output alone. As LLM-based systems increasi…

本文如何被排名

报道来源 [1]

模型内部的呼叫：调查 LLM 中基于探针的工具调用错误检测

相关实体

相关话题