PulseAugur
中
实时 11:10:53
English(EN) SemiAnalysis's new GDPx benchmark tests AI agents across 11 domains, from chip design to cybersecurity. Opus 5.5 tops it at just 12%. How it works: benchmarks a

SemiAnalysis 发布 GDPx 基准测试,揭示顶级 AI 代理得分偏低

SemiAnalysis 推出了新的 GDPx 基准测试,旨在评估 AI 代理在 11 个领域的实际专业任务表现,包括芯片设计和量化交易。该基准测试衡量模型在长时间内的表现,任务预算为 8 小时。Claude Opus 5.5 目前以 12% 的得分领跑 GDPx 排行榜,紧随其后的是 Gemini 4 Carbon 和 GPT-6 Astra,这凸显了当前前沿模型在复杂、长周期工作中仍有巨大的改进空间。该基准测试还揭示了成本效益,显示顶级模型之间每项任务的成本存在显著差异,这对于代理部署至关重要。 AI

影响 为 AI 代理提供了一个新的、考虑成本的评估指标,影响专业工作流程的模型选择,并凸显了在金融和法律等领域当前的局限性。

排序理由 发布新的基准测试,用于评估 AI 模型在专业任务上的表现。

在 Mastodon — mastodon.social 阅读 →

AI 生成摘要 · Google Gemini · 来自 2 个来源。 我们如何撰写摘要 →

SemiAnalysis 发布 GDPx 基准测试,揭示顶级 AI 代理得分偏低

本文如何被排名

Signal score
2 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Research
发布新的基准测试,用于评估 AI 模型在专业任务上的表现。
Source corroboration
2 independent sources
Multiple independent publishers reporting the same story raises confidence that it's real and newsworthy.
Topics
product, other
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
1 days old
Coverage has settled into its steady-state source set.

完整方法见我们的编辑标准。

报道来源 [2]

  1. dev.to — LLM tag TIER_1 English(EN) · News ·

    SemiAnalysis launches GDPx, an agentic benchmark across 11 professional domains

    <p><a class="article-body-image-wrapper" href="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fcdn.bsky.app%2Fimg%2Ffeed_fullsize%2Fplain%2Fdid%3Aplc%3Azl7pjaqajbk5mlwalj62hiz2%2Fbafkreihb3pwjl5tmib2sk3xcq5sz2323…

  2. Mastodon — mastodon.social TIER_1 English(EN) · Tokenmaxradar ·

    SemiAnalysis's new GDPx benchmark tests AI agents across 11 domains, from chip design to cybersecurity. Opus 5.5 tops it at just 12%. How it works: benchmarks a

    SemiAnalysis's new GDPx benchmark tests AI agents across 11 domains, from chip design to cybersecurity. Opus 5.5 tops it at just 12%. How it works: benchmarks and leaderboards. # Benchmarks # AIAgents # Semiconductors # Cybersecurity # AI https:// tokenmaxradar.com Sources (cover…