English(EN) Obviously, there's an innuendo towards # jqwik in the above post. Think about it: I need to protect all my sites that don't just deliver plain HTTP files with #

用户部署 Anubis 来阻止无视 robots.txt 的 AI 爬虫

作者 PulseAugur 编辑部 · [1 个来源] · 2026-06-01 07:52

一位 Mastodon 用户对无视 robots.txt 的 AI 爬虫表示不满，因此部署了 Anubis 来保护他们的网站。该用户认为 AI 公司打破了不遵守这些指令的“道德契约”，因此有理由采取防御措施。 AI

排序理由用户在社交媒体平台上生成的内容，与工具相关，而非重要的行业事件。

在 Mastodon — mastodon.social 阅读 →

其他

AI 生成摘要 · Google Gemini · 来自 1 个来源。我们如何撰写摘要 →

报道来源 [1]

Mastodon — mastodon.social TIER_1 English(EN) · rotnroll666 · 2026-06-01 07:52

Obviously, there's an innuendo towards # jqwik in the above post. Think about it: I need to protect all my sites that don't just deliver plain HTTP files with #

Obviously, there's an innuendo towards # jqwik in the above post. Think about it: I need to protect all my sites that don't just deliver plain HTTP files with # Anubis these days. Non of the fucking # AI scrapers obeys robots.txt (the equivalent of "pretty please"). Anubis is rea…

报道来源 [1]

Obviously, there's an innuendo towards # jqwik in the above post. Think about it: I need to protect all my sites that don't just deliver plain HTTP files with #

相关实体

相关话题