PulseAugur
中
实时 06:26:24
English(EN) Judges Follow the Reference: The Derivation Gap in Verifying Tool-Call Arguments

新的“DeRef”模型弥合了 LLM 代理工具调用验证中的推导差距

作者 PulseAugur 编辑部 · [2 个来源] ·

研究人员发现，在 LLM 代理评估工具调用参数时存在一个“推导差距”，即如果值缺乏明确的文本参考，法官就越不可能接受正确的值。即使值是默认值或推断值，这种差距仍然存在，并且法官会优先考虑可见的错误参考而不是隐藏的正确参考。为了解决这个问题，开发了一个名为 DeRef 的新模型，为法官提供必要的参考，从而显著提高了多个基准测试中参数评估的准确性。 AI

影响 通过解决特定的评估差距，引入了一种提高 LLM 代理执行任务可靠性的方法。

排序理由 该集群包含一篇详细介绍改进 LLM 代理性能新方法的论文。[lever_c_demoted from research: ic=1 ai=1.0]

在 Hugging Face Daily Papers 阅读 →

AI 生成摘要 · Google Gemini · 来自 2 个来源。 我们如何撰写摘要 →

新的“DeRef”模型弥合了 LLM 代理工具调用验证中的推导差距

本文如何被排名

Signal score
0 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Tool
该集群包含一篇详细介绍改进 LLM 代理性能新方法的论文。[lever_c_demoted from research: ic=1 ai=1.0]
Source corroboration
2 independent sources
Multiple independent publishers reporting the same story raises confidence that it's real and newsworthy.
Topics
paper, model release
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
2 days old
Coverage has settled into its steady-state source set.
Coverage growth since scoring
+1 source(s) since last score
New sources have picked up this story since our last re-score. Score will update on the next scoring pass.

完整方法见我们的编辑标准。

报道来源 [2]

  1. arXiv cs.AI TIER_1 English(EN) · Linhai Ma, Yan Wang, Lingfei Qian, Yupeng Cao, Victor Gutierrez Basulto ·

    法官遵循参考：验证工具调用参数中的推导差距

    arXiv:2610.18497v1 Announce Type: new Abstract: Tool-call judges evaluate argument values proposed by LLM agents. We find that they accept a correct value less often when their input holds no reference for it, that is, no text that says what the value should be. This happens when…

  2. Hugging Face Daily Papers TIER_1 English(EN) ·

    法官遵循参考：验证工具调用参数中的派生差距

    Tool-call judges evaluate argument values proposed by LLM agents. We find that they accept a correct value less often when their input holds no reference for it, that is, no text that says what the value should be. This happens when the value is a default value from the function …

相关实体

相关话题