PulseAugur
EN
LIVE 09:56:15

44 Language Models Show Surprising Conformity in "One-Word Census" Study

A new research paper, "The One-Word Census," reveals that 44 language models exhibit significant answer-choice conformity when asked to provide a single word from a broad category. Across 31 categories, models frequently converged on the same answer, with "serendipity" being the most common choice when prompted to "pick a word." The study found that newer flagship models tend to be more conformist, while persona-tuned models are more divergent. Notably, the latest flagship models from Claude and GPT lineages showed a reversal in conformity, suggesting a potential shift in their development. AI

IMPACT Reveals insights into the internal decision-making and convergence patterns of large language models, potentially influencing future model development and evaluation methods.

RANK_REASON Research paper published on arXiv detailing a study of language model behavior.

Read on arXiv cs.AI →

AI-generated summary · Google Gemini · from 2 sources. How we write summaries →

44 Language Models Show Surprising Conformity in "One-Word Census" Study

COVERAGE [2]

  1. arXiv cs.AI TIER_1 English(EN) · Tapan Parikh ·

    The One-Word Census: Answer-Choice Conformity Across 44 Language Models

    arXiv:2607.12796v1 Announce Type: cross Abstract: When a language model must pick one answer from a large space of equally valid options, which does it pick -- and how often is it the same answer every other model picks? Asked to "pick a word -- any word," 44 models chose "serend…

  2. arXiv cs.AI TIER_1 English(EN) · Tapan Parikh ·

    The One-Word Census: Answer-Choice Conformity Across 44 Language Models

    When a language model must pick one answer from a large space of equally valid options, which does it pick -- and how often is it the same answer every other model picks? Asked to "pick a word -- any word," 44 models chose "serendipity" 41% of the time. We characterize this conve…