PulseAugur
EN
LIVE 21:58:27

Human forecasters narrowly beat AI bots in FutureEval, but the gap is closing

In the latest FutureEval spring results, human forecasters narrowly outperformed AI bots, though the difference was not statistically significant. The AI bot team showed notable improvement over the past year, significantly closing the gap with human forecasters. While most individual humans still outperformed individual bots, the performance of AI models like OpenAI's GPT-5.1 and higher suggests continued advancement in AI forecasting capabilities. AI

IMPACT AI models are showing significant progress in forecasting, narrowing the gap with human experts and indicating potential for future applications.

RANK_REASON The cluster reports on the results of a forecasting benchmark, comparing human and AI performance. [lever_c_demoted from research: ic=1 ai=1.0]

Read on LessWrong (AI tag) →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

Human forecasters narrowly beat AI bots in FutureEval, but the gap is closing

How we ranked this

Signal score
9 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Tool
The cluster reports on the results of a forecasting benchmark, comparing human and AI performance. [lever_c_demoted from research: ic=1 ai=1.0]
Source corroboration
Single-source cluster
Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics
other
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
Same-day
Cluster formed today. Ranking reflects the current source set at time of score.

Full methodology in our editorial standards.

COVERAGE [1]

  1. LessWrong (AI tag) TIER_1 English(EN) · Ben Wilson ·

    FutureEval Spring Results: Pros Beat Bots, but the Gap is Nearly Gone

    <h1><span>Main Takeaways</span></h1><p><b><span>Top Findings:</span></b></p><ul><li value="1"><b><span>Pro forecasters beat bots but without significance</span></b><span>: Our team of 10 </span><a href="https://www.metaculus.com/pro-forecasters/"><span>Metaculus Pro Forecasters</…