Cloudflare data indicates that AI bots are crawling websites at an extremely high rate, reaching up to 50,000 visits per human visitor. This surge in AI crawling activity coincides with a Munich court ruling that removes Google's liability shield for its AI Overviews feature. Google is also facing pushback on its crawler standards and has dismissed a rival standard. AI
IMPACT Increased scrutiny and potential regulation of AI crawling and content generation practices may impact data access and AI model training.
RANK_REASON Significant legal and industry pushback against AI crawling practices and AI-generated content liability.
Read on Mastodon — mastodon.social →
AI-generated summary · Google Gemini · from 2 sources. How we write summaries →