PulseAugur
EN
LIVE 21:00:53

Apache server admin fights AI scrapers with mod_qos

A server administrator has implemented mod_qos on an Apache2 server to mitigate excessive requests from AI scrapers that were ignoring robots.txt. These scrapers were overwhelming the Git hosting service with inefficient requests, such as querying every single file instead of cloning repositories. The administrator expressed frustration with the current AI landscape and urged others to reject AI usage. AI

IMPACT AI scrapers are causing operational issues for web servers, leading to calls for reduced AI usage.

RANK_REASON The item expresses a personal opinion and frustration about AI scrapers, rather than reporting on a new AI development, release, or significant industry event.

Read on Mastodon — fosstodon.org →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

Apache server admin fights AI scrapers with mod_qos

COVERAGE [1]

  1. Mastodon — fosstodon.org TIER_1 English(EN) · [email protected] ·

    I've now added mod-qos.sourceforge.net/ to our # apache2 server to limit connections to my Git # Hosting . It was hammered by too many stupid requests, ignoring

    I've now added mod-qos.sourceforge.net/ to our # apache2 server to limit connections to my Git # Hosting . It was hammered by too many stupid requests, ignoring robots.txt, probably by # AI scrapers ignoring all existing rules. This now limits resources for one host, leaving all …