PulseAugur
EN
LIVE 09:07:55

Meta, Alibaba AI bots nearly destroy LGBT history archive

By PulseAugur Editorial · [2 sources] ·

AI crawlers from Meta and Alibaba Group nearly took down the volunteer-run LGBT History Project, an archive with over 50 million views since 2011. The intense bot traffic significantly slowed the website and increased operational costs. The archive, which has been preserved by the British Library, faced a critical threat to its accessibility due to this scraping activity. AI

IMPACT AI web scraping practices pose a threat to digital archives and volunteer-run projects, necessitating better bot management and content protection strategies.

RANK_REASON The cluster describes the impact of AI crawlers on a specific website, fitting the 'tool' category as it details the use of AI technology (crawlers) and its effect on a non-AI-focused entity.

Read on Mastodon — mastodon.social →

AI-generated summary · Google Gemini · from 2 sources. How we write summaries →

Meta, Alibaba AI bots nearly destroy LGBT history archive

How we ranked this

Signal score
0 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Tool
The cluster describes the impact of AI crawlers on a specific website, fitting the 'tool' category as it details the use of AI technology (crawlers) and its effect on a non-AI-focused entity.
Source corroboration
2 independent sources
Multiple independent publishers reporting the same story raises confidence that it's real and newsworthy.
Topics
other
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
Standard
On-topic for AI-industry coverage; kept in the public index.
Story freshness
78 days old
Aged out of breaking-news scoring windows; ranking reflects the durable signal from the full source set.

Full methodology in our editorial standards.

COVERAGE [2]

  1. Mastodon — sigmoid.social TIER_1 English(EN) · [email protected] ·

    Fast Company: AI crawlers from Meta and Alibaba almost destroyed a volunteer-run LGBT history archive. “…the LGBT History Project… recently passed 50 million vi

    Fast Company: AI crawlers from Meta and Alibaba almost destroyed a volunteer-run LGBT history archive. “…the LGBT History Project… recently passed 50 million views since its launch in 2011 and has been archived by the British Library for posterity. But an onslaught of AI bots see…

  2. Mastodon — mastodon.social TIER_1 English(EN) · [email protected] ·

    AI crawlers from Meta and Alibaba almost destroyed a volunteer-run LGBT history archive https://www.fastcompany.com/91589354/ai-crawlers-hammered-a-volunteer-ru

    AI crawlers from Meta and Alibaba almost destroyed a volunteer-run LGBT history archive https://www.fastcompany.com/91589354/ai-crawlers-hammered-a-volunteer-run-lgbt-history-archive-2 # AI # Tech # Community

    LINKS fastcompany.com/…/ai-crawlers-hammered-a-…

RELATED ENTITIES

RELATED TOPICS