PulseAugur
EN
LIVE 16:15:26

Web standards may block AI data scraping and restrict open web access

Proposed web standards could significantly restrict legitimate data scraping and crawling, impacting researchers, archivists, and startups. The AI Preferences working group is developing signals to block AI-related data use, while the Web Bot Auth group aims to cryptographically identify bots, potentially enabling sites to block any unauthorized access and impose licensing fees. While some measures aim to protect against resource-straining bots, the broader implications could lead to a less open web. AI

IMPACT Proposed web standards could limit data access for AI training and research, potentially increasing costs for startups and researchers.

RANK_REASON Article discusses proposed web standards and their potential impact on data scraping and AI model training, reflecting an opinion or analysis rather than a direct event.

Read on Mastodon — fosstodon.org →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

Web standards may block AI data scraping and restrict open web access

COVERAGE [1]

  1. Mastodon — fosstodon.org TIER_1 English(EN) · [email protected] ·

    "The worst of these proposed standards would give websites far greater ability to automatically block legitimate, lawful scraping and crawling. For example, the

    "The worst of these proposed standards would give websites far greater ability to automatically block legitimate, lawful scraping and crawling. For example, the AI Preferences working group is working on proposals to give publishers a way to express “preference signals” against c…