Nearly half of audited sites use llms.txt, but many lack useful descriptions

A recent audit of 123 websites revealed that nearly half (47%) have an `llms.txt` file, a convention for providing language models with a curated map of a site's important pages. While many sites use templated or plugin-generated files, a significant portion still lack descriptive text for the links, diminishing their utility for AI models. The audit also found a notable number of dead links in these files, suggesting they are often created and then neglected. AI

IMPACT This convention could improve AI's ability to navigate and understand websites, but current implementations often lack the necessary detail to be fully effective.

RANK_REASON Analysis of a technical convention for AI search.

Read on dev.to — LLM tag →

• All in One SEO
• llms-full.txt
• llms.txt
• Rank Math
• Yoast SEO

• product
• infra

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →