PulseAugur
EN
LIVE 18:18:08

Most websites are not cited by AI, despite low crawler blocking rates · 2 sources tracked

By PulseAugur Editorial · [3 sources] ·

A recent analysis indicates that a vast majority of websites are not cited by AI models, despite a relatively low percentage of sites actively blocking AI crawlers. The study found that only 8.9% of websites employ measures to prevent AI from accessing their content, while a significantly higher 94.8% of sites are never referenced in AI-generated answers. This suggests a disconnect between website owners' efforts to control AI access and the actual utilization of their content by AI systems. AI

IMPACT Highlights a potential gap in how AI models utilize web content, suggesting a need for better understanding of AI's information consumption patterns.

RANK_REASON The cluster discusses a report about AI crawler visibility and citation rates, which falls under commentary on AI usage and web content.

Read on Mastodon — fosstodon.org →

AI-generated summary · Google Gemini · from 3 sources. How we write summaries →

Most websites are not cited by AI, despite low crawler blocking rates · 2 sources tracked

How we ranked this

Signal score
0 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Commentary
The cluster discusses a report about AI crawler visibility and citation rates, which falls under commentary on AI usage and web content.
Source corroboration
3 independent sources
Multiple independent publishers reporting the same story raises confidence that it's real and newsworthy.
Topics
other
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
Standard
On-topic for AI-industry coverage; kept in the public index.
Story freshness
55 days old
Aged out of breaking-news scoring windows; ranking reflects the durable signal from the full source set.
Coverage growth since scoring
+1 source(s) since last score
New sources have picked up this story since our last re-score. Score will update on the next scoring pass.

Full methodology in our editorial standards.

COVERAGE [3]

  1. Mastodon — fosstodon.org TIER_1 English(EN) · [email protected] ·

    📜 Latest Top Story on # HackerNews : Only 8.9% of sites block AI crawlers, but 94.8% are never cited in AI answers 🔍 Original Story: https:// website-auditor.io

    📜 Latest Top Story on # HackerNews : Only 8.9% of sites block AI crawlers, but 94.8% are never cited in AI answers 🔍 Original Story: https:// website-auditor.io/ai-visibili ty-index 👤 Author: SpikeyCoder ⭐ Score: 16 💬 Number of Comments: 7 🕒 Posted At: 2026-08-02 11:53:52 UTC 🔗 U…

    LINKS website-auditor.io/ai-visibility-index
  2. Mastodon — fosstodon.org TIER_1 English(EN) · [email protected] ·

    Only 8.9% of sites block AI crawlers, but 94.8% are never cited in AI answers https:// website-auditor.io/ai-visibili ty-index # ai

    Only 8.9% of sites block AI crawlers, but 94.8% are never cited in AI answers https:// website-auditor.io/ai-visibili ty-index # ai

    LINKS website-auditor.io/ai-visibility-index
  3. Mastodon — mastodon.social TIER_1 English(EN) · [email protected] ·

    Only 8.9% of sites block AI crawlers, but 94.8% are never cited in AI answers Article URL: https:// website-auditor.io/ai-visibili ty-index Comments URL: https:

    Only 8.9% of sites block AI crawlers, but 94.8% are never cited in AI answers Article URL: https:// website-auditor.io/ai-visibili ty-index Comments URL: https:// news.ycombinator.com/item?id=4 9143630 Points: 3 # Comments: 0 https:// website-auditor.io/ai-visibili ty-index # Tec…

    LINKS website-auditor.io/ai-visibility-index

RELATED ENTITIES

RELATED TOPICS