PulseAugur
EN
LIVE 06:25:44

New 'DeRef' model bridges derivation gap in LLM agent tool-call verification

By PulseAugur Editorial · [2 sources] ·

Researchers have identified a "derivation gap" in how LLM agents evaluate tool-call arguments, where judges are less likely to accept correct values if they lack explicit textual references. This gap persists even when values are defaults or inferred, and judges prioritize visible incorrect references over hidden correct ones. To address this, a new model called DeRef has been developed to provide judges with necessary references, significantly improving argument evaluation accuracy across multiple benchmarks. AI

IMPACT Introduces a method to improve the reliability of LLM agents in executing tasks by addressing a specific evaluation gap.

RANK_REASON The cluster contains a research paper detailing a new method for improving LLM agent performance. [lever_c_demoted from research: ic=1 ai=1.0]

Read on Hugging Face Daily Papers →

AI-generated summary · Google Gemini · from 2 sources. How we write summaries →

New 'DeRef' model bridges derivation gap in LLM agent tool-call verification

How we ranked this

Signal score
0 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Tool
The cluster contains a research paper detailing a new method for improving LLM agent performance. [lever_c_demoted from research: ic=1 ai=1.0]
Source corroboration
2 independent sources
Multiple independent publishers reporting the same story raises confidence that it's real and newsworthy.
Topics
paper, model release
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
2 days old
Coverage has settled into its steady-state source set.
Coverage growth since scoring
+1 source(s) since last score
New sources have picked up this story since our last re-score. Score will update on the next scoring pass.

Full methodology in our editorial standards.

COVERAGE [2]

  1. arXiv cs.AI TIER_1 English(EN) · Linhai Ma, Yan Wang, Lingfei Qian, Yupeng Cao, Victor Gutierrez Basulto ·

    Judges Follow the Reference: The Derivation Gap in Verifying Tool-Call Arguments

    arXiv:2610.18497v1 Announce Type: new Abstract: Tool-call judges evaluate argument values proposed by LLM agents. We find that they accept a correct value less often when their input holds no reference for it, that is, no text that says what the value should be. This happens when…

  2. Hugging Face Daily Papers TIER_1 English(EN) ·

    Judges Follow the Reference: The Derivation Gap in Verifying Tool-Call Arguments

    Tool-call judges evaluate argument values proposed by LLM agents. We find that they accept a correct value less often when their input holds no reference for it, that is, no text that says what the value should be. This happens when the value is a default value from the function …

RELATED ENTITIES

RELATED TOPICS