PulseAugur
EN
LIVE 03:19:24

Grokipedia rated less neutral than Wikipedia by LLM judges

A new study published on arXiv investigated the political neutrality of Grokipedia, an encyclopedia created by the LLM Grok, comparing it to Wikipedia. The research analyzed 1,394 article pairs about government members across nine ideology dimensions using four LLM judges: Grok, Claude, Mistral, and DeepSeek. Contrary to its aim of being an unbiased alternative, Grokipedia was rated as less neutral than Wikipedia by all LLM judges. While both encyclopedias were found to portray politicians favorably, they exhibited different ideological biases, with Grokipedia favoring economically right-wing politicians and penalizing socially liberal ones, whereas Wikipedia showed a bias towards the latter. AI

IMPACT This research suggests that LLM-generated encyclopedias may embed different, rather than fewer, ideological biases compared to human-curated sources.

RANK_REASON The cluster contains a research paper published on arXiv detailing an audit of LLM-generated content.

Read on arXiv cs.CL →

AI-generated summary · Google Gemini · from 2 sources. How we write summaries →

Grokipedia rated less neutral than Wikipedia by LLM judges

COVERAGE [2]

  1. arXiv cs.CL TIER_1 English(EN) · Filippos Vlahos, Guillaume Bied, Tijl De Bie ·

    Grokipedia vs Wikipedia: An LLM-Based Audit of Political Neutrality along Ideologies

    arXiv:2607.15146v1 Announce Type: new Abstract: Online encyclopedias shape political opinion and, through it, democratic discourse. In late 2025, Grokipedia was released, an encyclopedia written entirely by the LLM Grok. One motivation behind the project was to provide an unbiase…

  2. arXiv cs.CL TIER_1 English(EN) · Tijl De Bie ·

    Grokipedia vs Wikipedia: An LLM-Based Audit of Political Neutrality along Ideologies

    Online encyclopedias shape political opinion and, through it, democratic discourse. In late 2025, Grokipedia was released, an encyclopedia written entirely by the LLM Grok. One motivation behind the project was to provide an unbiased alternative to Wikipedia, which has faced accu…