Cloudflare is introducing new policies to address the imbalance created by generative AI's consumption of online content. Starting September 15, 2026, Cloudflare will block AI crawlers from accessing advertising-supported pages by default, while allowing traditional search engine crawlers. The company is also evolving its 'Pay Per Crawl' model to 'Pay Per Use,' enabling publishers to be compensated when their content is used in AI results or by AI agents. This initiative aims to create a more equitable ecosystem where content creators are recognized and potentially paid for the value their work provides to AI systems, with initial partners including Ceramic.ai and You.com. AI
IMPACT This move could fundamentally alter how AI models are trained and how content creators are compensated, potentially accelerating the development of paid content ecosystems for AI.
RANK_REASON Cloudflare, a major infrastructure provider, is implementing a significant policy change that impacts the AI industry's access to web content and introduces a new payment model for publishers.
- AI companies
- Ceramic.ai
- Cloudflare
- Google Search
- Matthew Prince
- Pay Per Crawl
- Pay Per Use
- September 15, 2026
- You.com
AI-generated summary · Google Gemini · from 5 sources. How we write summaries →