PulseAugur
EN
LIVE 16:05:35

LLMs produce biased, stylized 'tastes' in survey surrogates, study finds

By PulseAugur Editorial · [2 sources] ·

A new research paper explores the use of large language models (LLMs) as surrogates for human survey respondents, finding their generated tastes to be stylized and biased facsimiles of human preferences. The study utilized models from OpenAI, Anthropic, and DeepSeek to create nearly 277,500 "silicon surrogates" for the Survey of Public Participation in the Arts (SPPA). Key findings indicate that these LLM-generated responses exhibit a positive bias towards liking, lose complex relational structures found in human tastes, and distort known associations between culture, age, class, gender, and race. AI

IMPACT Highlights potential biases and inaccuracies when using LLMs for survey data, cautioning against over-reliance on synthetic respondents.

RANK_REASON Research paper published on arXiv detailing findings about LLM behavior.

Read on arXiv cs.CL →

AI-generated summary · Google Gemini · from 2 sources. How we write summaries →

LLMs produce biased, stylized 'tastes' in survey surrogates, study finds

How we ranked this

Signal score
0 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Research
Research paper published on arXiv detailing findings about LLM behavior.
Source corroboration
2 independent sources
Multiple independent publishers reporting the same story raises confidence that it's real and newsworthy.
Topics
paper, other
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
89 days old
Aged out of breaking-news scoring windows; ranking reflects the durable signal from the full source set.

Full methodology in our editorial standards.

COVERAGE [2]

  1. arXiv cs.CL TIER_1 English(EN) · Xiangyu Ma, Mengmi Zhang, Shannon Ang, Minne Chen ·

    Not-quite-human tastes: the stylized omnivorousness of LLM survey surrogates

    arXiv:2606.30085v1 Announce Type: new Abstract: Large-language models have proven to be remarkable if inconsistent parrots of public attitudes and opinions. The extent to which LLMs are able to produce reasonable approximations of cultural taste remains an open empirical question…

  2. arXiv cs.CL TIER_1 English(EN) · Minne Chen ·

    Not-quite-human tastes: the stylized omnivorousness of LLM survey surrogates

    Large-language models have proven to be remarkable if inconsistent parrots of public attitudes and opinions. The extent to which LLMs are able to produce reasonable approximations of cultural taste remains an open empirical question that becomes more urgent by the day, with marke…

RELATED ENTITIES

RELATED TOPICS