When Synthetic Users Fail: A Cross-Domain Benchmark of LLM-Simulated Human Survey Responses

By PulseAugur Editorial · [1 sources] · 2026-07-30 04:00

A new benchmark framework, AI

RANK_REASON [lever_c_demoted from research: ic=1 ai=1.0]

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

COVERAGE [1]

arXiv cs.CL TIER_1 English(EN) · Zihan Chen, Di Zhu, Lei Nico Zheng · 2026-07-30 04:00

When Synthetic Users Fail: A Cross-Domain Benchmark of LLM-Simulated Human Survey Responses

arXiv:2607.26348v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly used as synthetic users, stand-ins for human respondents whose simulated answers feed product, policy, and market decisions. We ask when this substitution is valid and when it fails, and…