PulseAugur
实时 07:09:37

LLM spiders strain version control systems, prompting access restrictions

Large Language Model (LLM) web crawlers are reportedly causing significant strain on version control backends, particularly those with web-based frontends. One user noted that these spiders scrape every commit, leading to massive load. This has prompted discussions about disabling public web access to repositories in favor of direct cloning for non-commercial users. AI

影响 LLM data scraping may necessitate changes in how code repositories are accessed and secured.

排序理由 User commentary on the impact of LLM crawlers on version control systems.

在 Mastodon — fosstodon.org 阅读 →

AI 生成摘要 · Google Gemini · 来自 1 个来源。 我们如何撰写摘要 →

LLM spiders strain version control systems, prompting access restrictions

报道来源 [1]

  1. Mastodon — fosstodon.org TIER_1 English(EN) · [email protected] ·

    @ mgorny I've heard before that a WWW front-end to version control is one of the worst. The LLM spiders scrape every commit and the load on the back end is mass

    @ mgorny I've heard before that a WWW front-end to version control is one of the worst. The LLM spiders scrape every commit and the load on the back end is massive. I can see a future where non-commercial people with vc repositories disable all of the mechanism for strangers read…