PulseAugur
EN
LIVE 20:26:56

AI benchmarks cover only 10% of US working hours, study finds · 4 sources tracked

By PulseAugur Editorial · [5 sources] ·

A new report from Mercor indicates that existing AI benchmarks poorly cover the vast majority of tasks performed in the US economy. Out of 923 occupations and 18,797 tasks analyzed, only 208 occupations and a small fraction of tasks have significant benchmark prompt coverage. This gap means that current AI models' capabilities are not well understood in relation to the actual work Americans do, with a focus on larger labor markets like law while neglecting smaller, middle-income knowledge work jobs. AI

IMPACT Highlights a significant disconnect between AI development and real-world job tasks, potentially slowing effective AI adoption in many sectors.

RANK_REASON Analysis of AI benchmark coverage by a research firm, disseminated via news aggregators.

Read on Mastodon — mastodon.social →

AI-generated summary · Google Gemini · from 5 sources. How we write summaries →

AI benchmarks cover only 10% of US working hours, study finds · 4 sources tracked

How we ranked this

Signal score
3 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Commentary
Analysis of AI benchmark coverage by a research firm, disseminated via news aggregators.
Source corroboration
5 independent sources
Strong cross-source corroboration — multiple independent publishers covered this within the clustering window.
Topics
other
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
Breaking (< 6h)
Fresh story with cross-source coverage still developing. Ranking may shift as more sources report.
Coverage growth since scoring
+1 source(s) since last score
New sources have picked up this story since our last re-score. Score will update on the next scoring pass.

Full methodology in our editorial standards.

COVERAGE [5]

  1. Hacker News — AI stories ≥50 points TIER_1 English(EN) · speckx ·

    90% of US working hours are spent on tasks not covered well by AI benchmarks

  2. Mastodon — mastodon.social TIER_1 English(EN) · [email protected] ·

    “90% of American working hours are spent on tasks with little or no coverage from existing [AI] benchmarks" https://www. mercor.com/research/labor-inde x/benchm

    “90% of American working hours are spent on tasks with little or no coverage from existing [AI] benchmarks" https://www. mercor.com/research/labor-inde x/benchmark-map/ # AI

    LINKS mercor.com/…/benchmark-map
  3. Mastodon — mastodon.social TIER_1 English(EN) · hacker_news_bot ·

    📜 Latest Top Story on # HackerNews : 90% of US working hours are spent on tasks not covered well by AI benchmarks 🔍 Original Story: https://www. mercor.com/rese

    📜 Latest Top Story on # HackerNews : 90% of US working hours are spent on tasks not covered well by AI benchmarks 🔍 Original Story: https://www. mercor.com/research/labor-inde x/benchmark-map/ 👤 Author: speckx ⭐ Score: 30 💬 Number of Comments: 6 🕒 Posted At: 2026-10-16 17:08:38 U…

    LINKS mercor.com/…/benchmark-map
  4. Mastodon — mastodon.social TIER_1 English(EN) · h4ckernews ·

    90% of US working hours are spent on tasks not covered well by AI benchmarks https://www. mercor.com/research/labor-inde x/benchmark-map/ Comments: https:// new

    90% of US working hours are spent on tasks not covered well by AI benchmarks https://www. mercor.com/research/labor-inde x/benchmark-map/ Comments: https:// news.ycombinator.com/item?id=5 0121179 # HackerNews # AI # Labor # Productivity # Workbench # AI # Benchmarks # Future # of…

    LINKS mercor.com/…/benchmark-map
  5. Mastodon — mastodon.social TIER_1 English(EN) · CuratedHackerNews ·

    90% of US working hours are spent on tasks not covered well by AI benchmarks https://www. mercor.com/research/labor-inde x/benchmark-map/ # ai

    90% of US working hours are spent on tasks not covered well by AI benchmarks https://www. mercor.com/research/labor-inde x/benchmark-map/ # ai

    LINKS mercor.com/…/benchmark-map

RELATED ENTITIES

RELATED TOPICS