PulseAugur
EN
LIVE 23:06:27

Hugging Face expands voice agent benchmark to 3 domains, 121 tools

Hugging Face has released EVA-Bench Data 2.0, an expanded benchmark for evaluating voice agents. This new version broadens its scope to three enterprise domains: Airline Customer Service Management, Enterprise IT Service Management, and Healthcare HR Service Delivery. The updated dataset includes 213 scenarios across 121 tools, a significant increase from its previous iteration, and has been validated against leading models like GPT-5.4, Gemini 3.1 Pro, and Claude Opus 4.6. AI

IMPACT Provides a more comprehensive and realistic evaluation framework for voice agents, pushing development towards better handling of complex enterprise tasks.

RANK_REASON Release of a new version of an evaluation benchmark dataset with expanded scope and scenarios.

Read on Hugging Face Blog →

AI-generated summary · Google Gemini · from 2 sources. How we write summaries →

Hugging Face expands voice agent benchmark to 3 domains, 121 tools

How we ranked this

Signal score
0 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Research
Release of a new version of an evaluation benchmark dataset with expanded scope and scenarios.
Source corroboration
2 independent sources
Multiple independent publishers reporting the same story raises confidence that it's real and newsworthy.
Topics
paper, product
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
114 days old
Aged out of breaking-news scoring windows; ranking reflects the durable signal from the full source set.

Full methodology in our editorial standards.

COVERAGE [2]

  1. Hugging Face Blog TIER_1 English(EN) ·

    EVA-Bench Data 2.0: 3 Domains, 121 Tools, 213 Scenarios

  2. Mastodon — fosstodon.org TIER_1 日本語(JA) · [email protected] ·

    EVA-Bench Data 2.0: 3 Domains, 121 Tools, 213 Scenarios https:// huggingface.co/blog/ServiceNow -AI/eva-bench-data ※AI-generated auto-post (headline + link) # AI # GenerativeAI # LLM # AIGenerated

    【EVA-Bench Data 2.0:3つのドメイン、121のツール、213のシナリオ】 https:// huggingface.co/blog/ServiceNow -AI/eva-bench-data ※AI生成の自動投稿(見出し+リンク) # AI # 生成AI # LLM # AIGenerated