Mastodon is implementing Anubis, a system designed to deter AI companies from aggressively scraping websites. Anubis employs a Proof-of-Work scheme, similar to Hashcash, to increase the computational cost for mass scrapers, thereby protecting website resources and ensuring accessibility for all users. The ultimate goal is to develop more sophisticated methods for identifying and blocking automated bots, such as by analyzing headless browser behavior, to minimize the need for users to complete challenges. AI
IMPACT This measure may increase the cost and difficulty for AI companies to gather data from public web platforms.
RANK_REASON Implementation of a new anti-scraping tool by a platform.
Read on Mastodon — mastodon.social →
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →