Cloudflare is introducing new controls to manage AI bot access to websites, differentiating between search bots, agent bots, and training bots. Starting September 15, 2026, new domains on Cloudflare will block agent and training bots by default on ad-supported pages, while search bots remain allowed. This move aims to give site owners more granular control over how their content is used by AI, distinguishing between discoverability and data extraction for model training. AI
IMPACT This feature allows website owners to better control how AI models access and use their content, potentially impacting AI training data availability and search engine indexing.
RANK_REASON Cloudflare is launching a new feature for its customers to manage AI bot access.
Read on Email — The Neuron Daily →
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →
