PulseAugur
EN
LIVE 08:47:55

New Hearsay benchmark reveals AI agent records are unreliable hearsay

A new benchmark called Hearsay has been developed to assess the auditability of records generated by deployed AI agent harnesses. The research highlights that when only a single harness writes the record, it constitutes "hearsay" and cannot be reliably checked, even by advanced model examiners. The study found that current frameworks predominantly use a single writer, leading to significant discrepancies between claimed evidence corroboration and actual labels, with models failing to detect many alterations. The introduction of a second writer, acting as a ledger, enables robust auditing of these records. AI

IMPACT Highlights a critical gap in AI agent reliability and auditability, potentially impacting trust and deployment in sensitive applications.

RANK_REASON Academic paper introducing a new benchmark for AI agent auditability. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.AI →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

New Hearsay benchmark reveals AI agent records are unreliable hearsay

How we ranked this

Signal score
20 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Tool
Academic paper introducing a new benchmark for AI agent auditability. [lever_c_demoted from research: ic=1 ai=1.0]
Source corroboration
Single-source cluster
Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics
paper, safety
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
Breaking (< 6h)
Fresh story with cross-source coverage still developing. Ranking may shift as more sources report.

Full methodology in our editorial standards.

COVERAGE [1]

  1. arXiv cs.AI TIER_1 English(EN) · Jiahong Dai, Zhuochen Yang, Pengyang Shao, Kelvin Ng, Zhongyi Liu, Chengquan Ju, Yuting He, Bo Hu ·

    Hearsay: Who Can Audit the Record a Deployed Agent Harness Writes?

    arXiv:2609.32495v2 Announce Type: replace-cross Abstract: The record of an agent's run is written by the harness that drives the agent. When the run is later disputed, the auditor was not there and has only this record. We ask whether someone who was not there can check the recor…