The author of a long-standing, intentionally unindexed blog hosted on WordPress.com has observed a significant increase in traffic from the United States over the past year, nearly matching that from Europe. This surge is particularly surprising given the blog's lack of search engine indexing and the fact that its content is often truncated when shared via ActivityPub to the Fediverse. The author speculates that AI crawlers might be accessing the content despite indexing restrictions or that readers are using automatic translation tools. AI
IMPACT Speculation on AI crawlers accessing non-indexed content may inform future data scraping strategies.
RANK_REASON Blog author reflects on traffic sources and AI crawlers.
Read on Mastodon — fosstodon.org →
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →
