PulseAugur
EN
LIVE 02:54:24

AI crawlers struggle to access 27% of Show HN products

A recent scan of 383 products launched on Show HN revealed significant accessibility issues for AI crawlers. Approximately 27% of these products were unreadable to automated systems, often due to client-side rendering without parsable server responses or aggressive bot filters. More surprisingly, 17% of the products actively blocked AI assistants like Claude, a measure frequently implemented by content delivery networks or web application firewalls rather than an explicit decision by the product founders. This invisibility means founders may misinterpret a lack of AI-driven demand as low product interest, as these failed requests do not appear in standard analytics dashboards. AI

IMPACT Highlights a critical gap in AI visibility for new products, potentially skewing market perception and demand signals.

RANK_REASON Analysis of product accessibility for AI crawlers, not a core AI release or research.

Read on dev.to — LLM tag →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

AI crawlers struggle to access 27% of Show HN products

COVERAGE [1]

  1. dev.to — LLM tag TIER_1 English(EN) · Mike Viewfy ·

    We scanned 383 Show HN products. 27% were unreadable to crawlers, 17% blocked Claude (and nobody wrote that rule)

    <p>Most founders assume that if a page loads in a browser and shows up in Google, an AI assistant can read it too. We scanned 383 products from Show HN with a script we keep in the repo. 27% were unreadable to crawlers, and 17% were blocked from Claude outright.</p> <h2> 27% of 3…