PulseAugur
EN
LIVE 23:15:15

Cloudflare to block AI/search crawlers by default from Sept. 15

By PulseAugur Editorial · [1 sources] ·

Cloudflare will begin blocking multi-purpose crawlers that scrape for both search indexing and AI training starting September 15th. This change will apply to all new websites signing up for Cloudflare and existing free-tier customers. Site owners can opt-out of this default setting if they wish to allow such crawlers. AI

IMPACT This policy change could impact the availability of web data for AI training, potentially affecting model development.

RANK_REASON Policy change by a major infrastructure provider affecting AI training data collection.

Read on Mastodon — fosstodon.org →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

Cloudflare to block AI/search crawlers by default from Sept. 15

COVERAGE [1]

  1. Mastodon — fosstodon.org TIER_1 English(EN) · [email protected] ·

    Amazing ! Thank-you # Cloudflare for holding the line against # Google and # AI "Beginning Sept. 15, all new websites signing up for Cloudflare, as well as all

    Amazing ! Thank-you # Cloudflare for holding the line against # Google and # AI "Beginning Sept. 15, all new websites signing up for Cloudflare, as well as all the customers on its free tier, will have the default settings in their bot management protocol set to block “multi-purp…

    LINKS adweek.com/…/publishers-opt-out-google-se… adweek.com

RELATED ENTITIES

RELATED TOPICS