PulseAugur
实时 12:57:08
English(EN) PieArena: Ranking and Profiling Language Agents in Realistic Negotiation Scenarios

新基准评估LLM谈判能力,GPT-5媲美人为基线

研究人员推出了PieArena,这是一个旨在评估大型语言模型谈判能力的新基准。该基准利用了从MBA谈判课程改编的真实场景,并在包括人机交互在内的各种配对模式下评估模型。评估超越了简单的结果分数,提供了多维度的行为画像,考察了指令遵循、欺骗和声誉等方面。值得注意的是,一个前沿模型GPT-5在这些谈判任务中的表现与人类基线相当或更优。 AI

影响 为评估LLM的战略推理和谈判能力建立了新标准,有望推动在商业应用中代理能力的提升。

排序理由 这是一篇介绍LLM新评估基准的研究论文。[lever_c_demoted from research: ic=1 ai=1.0]

在 arXiv cs.AI 阅读 →

AI 生成摘要 · Google Gemini · 来自 1 个来源。 我们如何撰写摘要 →

新基准评估LLM谈判能力,GPT-5媲美人为基线

本文如何被排名

Signal score
0 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Tool
这是一篇介绍LLM新评估基准的研究论文。[lever_c_demoted from research: ic=1 ai=1.0]
Source corroboration
Single-source cluster
Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics
paper, model release
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
95 days old
Aged out of breaking-news scoring windows; ranking reflects the durable signal from the full source set.

完整方法见我们的编辑标准

报道来源 [1]

  1. arXiv cs.AI TIER_1 English(EN) · Chris Zhu, Sasha Cui, Will Sanok Dufallo, Runzhi Jin, Zhen Xu, Linjun Zhang, Daylian Cain ·

    PieArena:在真实谈判场景中对语言代理进行排名和画像

    arXiv:2602.05302v3 Announce Type: replace Abstract: We present an in-depth evaluation of LLMs' ability to negotiate, a central business task requiring strategic reasoning, theory of mind, and economic value creation. To do so, we introduce PieArena, a large-scale negotiation benc…