PulseAugur
EN
LIVE 05:42:30

OpenAI, Google, Bing back robots.txt signal for AI training preferences · 7 sources tracked

By PulseAugur Editorial · [7 sources] ·

OpenAI, Google, and Microsoft Bing are adopting a new robots.txt signal, __usage_ai-training, to allow website owners to express preferences about using their content for AI model training. This signal is intended as a preference, not a strict block, and is separate from existing crawler rules. While the standard is under development and expected to be supported by Google in early 2027, its adoption and enforcement by AI companies are not yet mandatory. AI

IMPACT This new standard aims to give website owners more control over how their content is used for AI training, potentially impacting future model development and data sourcing.

RANK_REASON Significant industry policy change with major tech companies adopting a new standard.

Read on Towards AI →

AI-generated summary · Google Gemini · from 7 sources. How we write summaries →

OpenAI, Google, Bing back robots.txt signal for AI training preferences · 7 sources tracked

How we ranked this

Signal score
1 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Significant
Significant industry policy change with major tech companies adopting a new standard.
Source corroboration
7 independent sources
Strong cross-source corroboration — multiple independent publishers covered this within the clustering window.
Topics
policy, product
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
3 days old
Aged out of breaking-news scoring windows; ranking reflects the durable signal from the full source set.

Full methodology in our editorial standards.

COVERAGE [7]

  1. Towards AI TIER_1 English(EN) · Ethan Mark ·

    OpenAI AI Training Preferences in robots.txt: A Safe Rollout Guide for Web Teams

    <figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*76Ndk9Ocj38DrZ3GgaTbcg.jpeg" /><figcaption>OpenAI AI Training Preferences in robots.txt</figcaption></figure><p>A shared AI-training signal is arriving. Treat it as a versioned content-use policy — not a magic bo…

  2. Mastodon — mastodon.social TIER_1 English(EN) · ppcland ·

    FYI: Google and Bing back one robots.txt rule to opt out of AI training: Google and Bing said they will honour a shared robots.txt signal to block AI training,

    FYI: Google and Bing back one robots.txt rule to opt out of AI training: Google and Bing said they will honour a shared robots.txt signal to block AI training, as a study put AI Overviews click-through at 0.9% and Bing tested ads. https:// ppc.land/google-and-bing-back- one-robot…

    LINKS ppc.land/google-and-bing-back-one-robots-…
  3. Mastodon — mastodon.social TIER_1 English(EN) · [email protected] ·

    A standardised robots.txt signal for # AI training is coming in 2027. But AI companies won't be obliged to respect it. A step forward for publishers, but does i

    A standardised robots.txt signal for # AI training is coming in 2027. But AI companies won't be obliged to respect it. A step forward for publishers, but does it solve the problem? My thoughts in a new post (in Italian). https://www. linkedin.com/posts/marsella_ai -seo-share-7523…

    LINKS linkedin.com/…/marsella_ai-seo-share-7523…
  4. Mastodon — mastodon.social TIER_1 English(EN) · [email protected] ·

    A new policy token in robots.txt lets site owners set one AI training preference across major AI providers, though rollout timing varies and the signal isn't en

    A new policy token in robots.txt lets site owners set one AI training preference across major AI providers, though rollout timing varies and the signal isn't enforceable. https:// coywolf.com/news/seo/google-op enai-microsoft-and-anthropic-back-a-shared-robotstxt-ai-training-sign…

    LINKS coywolf.com/…/google-openai-microsoft-and…
  5. Mastodon — mastodon.social TIER_1 English(EN) · [email protected] ·

    🤖 Making it easier for websites to express AI training preferences OpenAI will honor a shared robots.txt signal to help website operators communicate their AI t

    🤖 Making it easier for websites to express AI training preferences OpenAI will honor a shared robots.txt signal to help website operators communicate their AI training preferences to participating providers. 📰 Source: OpenAI News 🔗 Link: https://openai.com/index/helping-websites-…

  6. Mastodon — mastodon.social TIER_1 English(EN) · [email protected] ·

    Making it easier for websites to express AI training preferences - OpenAI https:// openai.com/index/helping-websi tes-express-ai-training-preferences/ # AI # tr

    Making it easier for websites to express AI training preferences - OpenAI https:// openai.com/index/helping-websi tes-express-ai-training-preferences/ # AI # training

  7. r/OpenAI TIER_2 English(EN) · /u/rhiever ·

    OpenAI will honor a shared robots.txt signal so websites can opt out of AI training

    &#32; submitted by &#32; <a href="https://www.reddit.com/user/rhiever"> /u/rhiever </a> <br /> <span><a href="https://openai.com/index/helping-websites-express-ai-training-preferences">[link]</a></span> &#32; <span><a href="https://www.reddit.com/r/OpenAI/comments/1xl7ssz/openai_…

RELATED ENTITIES

RELATED TOPICS