PulseAugur
EN
LIVE 04:02:20
日本語(JA) AIが無人で書き溜めた社内ドキュメント1,355本をDiátaxisで仕分けたら、3割が自社のドキュメントですらなかった

AI-generated documents analyzed: 32% were extraneous, tutorials absent

An analysis of 1,355 internal documents generated by AI revealed that over 30% were not original content but rather tool-generated files. After removing these extraneous files, the remaining 917 documents were classified using the Diátaxis framework and a local LLM (qwen3.5:latest). The results showed a strong bias towards reference and explanation types, with a complete absence of tutorials, reflecting the AI agents' needs for factual retrieval and understanding rather than step-by-step learning. The process also uncovered a bug in the document processing script that incorrectly classified files within hidden directories. AI

IMPACT Highlights the nature of AI-generated content and the importance of data validation before analysis.

RANK_REASON Analysis of AI-generated content using a specific framework and LLM. [lever_c_demoted from research: ic=1 ai=1.0]

Read on dev.to — LLM tag →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

AI-generated documents analyzed: 32% were extraneous, tutorials absent

COVERAGE [1]

  1. dev.to — LLM tag TIER_1 日本語(JA) · bigkijimon ·

    When 1,355 internal documents written by AI without human intervention were sorted with Diátaxis, 30% were not even company documents.

    <p>Claude Codeに無人でドキュメントを書かせ続けて数か月経つと、「うちのナレッジベースは今どんな型に偏っているのか」が気になった。答え合わせに <a href="https://diataxis.fr/" rel="noopener noreferrer">Diátaxis</a>(Tutorials / How-to guides / Technical reference / Explanation の4分類フレームワーク)を使い、自社リポジトリの Markdown をローカルLLMで全数分類した。結果は「tutorial型が0.0%」と…