English(EN) I try to be friendly to "AI" search web crawlers but I'm on (pretty good) shared hosting and "Claude-SearchBot" has been hammering my site with ~12000 requests

AI 搜索机器人压垮主机，导致被屏蔽

作者 PulseAugur 编辑部 · [1 个来源] · 2026-06-12 04:03

一位网站管理员因“Claude-SearchBot”发送过多请求而将其屏蔽，给共享主机带来了巨大压力。此前，“Amzn-SearchBot”也因同样原因被屏蔽。该管理员将此与 GoogleBot 和 BingBot 的较轻影响进行了对比，并对 AI 公司在管理其网络爬虫方面的明显能力不足表示沮丧。 AI

影响 AI 搜索机器人的资源消耗会对网站性能产生负面影响，并可能导致访问受限。

排序理由用户对 AI 搜索机器人对网站托管的影响表示沮丧和看法。

在 Mastodon — fosstodon.org 阅读 →

AI 生成摘要 · Google Gemini · 来自 1 个来源。我们如何撰写摘要 →

报道来源 [1]

Mastodon — fosstodon.org TIER_1 English(EN) · [email protected] · 2026-06-12 04:03

I try to be friendly to "AI" search web crawlers but I'm on (pretty good) shared hosting and "Claude-SearchBot" has been hammering my site with ~12000 requests

I try to be friendly to "AI" search web crawlers but I'm on (pretty good) shared hosting and "Claude-SearchBot" has been hammering my site with ~12000 requests now, in intervals between 1-4 seconds. Inevitably, it ended up on the blocklist because of the excessive resource consum…

报道来源 [1]

I try to be friendly to "AI" search web crawlers but I'm on (pretty good) shared hosting and "Claude-SearchBot" has been hammering my site with ~12000 requests

相关话题