Cloudflare announced updated default settings for new domains, effective September 15, 2026. Bots categorized as 'Training' or 'Agent' will be blocked from accessing pages that display advertisements. The company will continue to allow search engine crawlers, but those that combine search and training functionalities will also be blocked. AI
IMPACT This policy change by Cloudflare could impact how AI models access data from websites displaying ads, potentially affecting training data collection.
RANK_REASON Policy change by a major infrastructure provider regarding bot traffic.
Read on Mastodon — fosstodon.org →
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →
