PulseAugur
EN
LIVE 15:35:45

LLMs produce biased, stylized 'tastes' in survey surrogates, study finds

A new research paper explores the use of large language models (LLMs) as surrogates for human survey respondents, finding their generated tastes to be stylized and biased facsimiles of human preferences. The study utilized models from OpenAI, Anthropic, and DeepSeek to create nearly 277,500 "silicon surrogates" for the Survey of Public Participation in the Arts (SPPA). Key findings indicate that these LLM-generated responses exhibit a positive bias towards liking, lose complex relational structures found in human tastes, and distort known associations between culture, age, class, gender, and race. AI

IMPACT Highlights potential biases and inaccuracies when using LLMs for survey data, cautioning against over-reliance on synthetic respondents.

RANK_REASON Research paper published on arXiv detailing findings about LLM behavior.

Read on arXiv cs.CL →

AI-generated summary · Google Gemini · from 2 sources. How we write summaries →

LLMs produce biased, stylized 'tastes' in survey surrogates, study finds

COVERAGE [2]

  1. arXiv cs.CL TIER_1 English(EN) · Xiangyu Ma, Mengmi Zhang, Shannon Ang, Minne Chen ·

    Not-quite-human tastes: the stylized omnivorousness of LLM survey surrogates

    arXiv:2606.30085v1 Announce Type: new Abstract: Large-language models have proven to be remarkable if inconsistent parrots of public attitudes and opinions. The extent to which LLMs are able to produce reasonable approximations of cultural taste remains an open empirical question…

  2. arXiv cs.CL TIER_1 English(EN) · Minne Chen ·

    Not-quite-human tastes: the stylized omnivorousness of LLM survey surrogates

    Large-language models have proven to be remarkable if inconsistent parrots of public attitudes and opinions. The extent to which LLMs are able to produce reasonable approximations of cultural taste remains an open empirical question that becomes more urgent by the day, with marke…