A recent analysis of 166 websites revealed a significant gap between claims of AI agent-friendliness and actual implementation. Only 39% of sites had an "llms.txt" file, 10% specified an AI crawler policy, and a mere 5% provided an "mcp.json" file, indicating a widespread lack of concrete measures to support AI agents. AI
IMPACT Highlights the need for standardized protocols and clear policies to facilitate AI agent interaction with web content.
RANK_REASON Analysis of existing website practices regarding AI agent support.
Read on Mastodon — fosstodon.org →
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →