PulseAugur
EN
LIVE 04:46:17

User creates 103B token Usenet corpus for AI training

By PulseAugur Editorial · [1 sources] ·

A user has compiled a 103 billion token Usenet corpus spanning from 1980 to 2013, emphasizing its value for training AI models due to its pre-internet, human-only content with zero AI contamination. The corpus is structured into various hierarchies like computing, science, and recreation, offering a unique dataset free from modern web artifacts and AI-generated text. A fine-tuned Gemma 4 model on a sample of this data has already demonstrated its potential, with samples available for download and the full corpus open for licensing. AI

IMPACT Provides a unique, AI-contamination-free dataset for fine-tuning models, potentially improving their raw human-like writing capabilities.

RANK_REASON User-created dataset release for AI training. [lever_c_demoted from research: ic=1 ai=1.0]

Read on r/LocalLLaMA →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

User creates 103B token Usenet corpus for AI training

How we ranked this

Signal score
0 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Tool
User-created dataset release for AI training. [lever_c_demoted from research: ic=1 ai=1.0]
Source corroboration
Single-source cluster
Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics
paper, product
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
132 days old
Aged out of breaking-news scoring windows; ranking reflects the durable signal from the full source set.

Full methodology in our editorial standards.

COVERAGE [1]

  1. r/LocalLLaMA TIER_1 English(EN) · /u/OwnerByDane ·

    I built a 103B-token Usenet corpus (1980–2013) — pre-web, human-only, zero AI contamination. Got strong traction on r/ML, thought this community would find it useful.

    <!-- SC_OFF --><div class="md"><p>Posted this to <a href="/r/MachineLearning">r/MachineLearning</a> a couple weeks ago (30K views, 100+ upvotes) and have been meaning to share it here where the fine-tuning angle is more directly relevant.</p> <p>I spent years building and process…

RELATED ENTITIES

RELATED TOPICS