A recent report indicates that 15% of AI page fetchers in Europe encountered disallowed URLs, with ChatGPT-User agents being blocked by nearly half of the European sites they accessed. Additionally, 9% of these sites also blocked Claude-User agents. Separately, Google is facing a complaint in France from publishers who claim that AI summaries have reduced their website traffic by up to 38%, potentially violating prior commitments. AI
IMPACT AI summarization tools may negatively impact publisher traffic, prompting regulatory scrutiny and changes in web scraping policies.
RANK_REASON The cluster discusses issues related to AI web scraping and the impact of AI summaries on website traffic, which are product and policy-related concerns rather than core AI research or releases.
Read on Mastodon — fosstodon.org →
AI-generated summary · Google Gemini · from 4 sources. How we write summaries →