Google, OpenAI, Anthropic, and Microsoft have committed to supporting a new standard within robots.txt files. This standard aims to prevent AI companies from scraping web content for training their models. The initiative seeks to establish a common signal that websites can use to explicitly block AI data collection. AI
IMPACT Establishes a potential industry standard for controlling AI model training data access.
RANK_REASON Policy announcement from major tech companies regarding AI training data.
Read on Mastodon — mastodon.social →
AI-generated summary · Google Gemini · from 3 sources. How we write summaries →