PulseAugur
EN
LIVE 22:38:32

Chess engine evaluations don't predict human outcomes, study finds

A study analyzing chess positions found that even when engines like Stockfish 18 deem them equal, human players exhibit consistent outcome skews, favoring either White or Black. These skews were reproducible across different player groups, time periods, and rating bands, and persisted even in highly popular and well-measured positions. While the typical skew is small, the disfavored side tends to spend more thinking time, suggesting that engine evaluations alone do not fully predict human game outcomes. AI

IMPACT Suggests that AI evaluations in complex domains may not fully capture human behavior or outcomes.

RANK_REASON Academic paper detailing a reproducible outcome skew in engine-assessed equal chess positions. [lever_c_demoted from research: ic=1 ai=0.4]

Read on Hugging Face Daily Papers →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

Chess engine evaluations don't predict human outcomes, study finds

COVERAGE [1]

  1. Hugging Face Daily Papers TIER_1 English(EN) ·

    Engine-Equal, Human-Unequal: A Reproducible Outcome Skew in Engine-Assessed Equal Chess Positions

    Among chess opening positions that a strong engine judges essentially equal (Stockfish 18 evaluation within 10 centipawns of zero, depth-stable) and that humans actually reach on Lichess (October 2025; 1,661 positions, 16.1M occurrences), human results are not balanced. Positions…