New research questions reliability of LLM-based human simulations

A new paper argues that current large language models (LLMs) are not yet reliable for simulating human behavior across various domains. The research systematically reviews LLM simulations in social, economic, policy, and psychological contexts, identifying limitations in both the models themselves and simulation design. To address these issues, the authors propose a framework for enhancing LLM simulation reliability through improved data, advanced LLM capabilities, and robust design, including a structured algorithm to guide future efforts. AI

IMPACT Highlights current limitations in LLM-based human simulations, suggesting a need for improved data and model capabilities for more accurate behavioral modeling.

RANK_REASON The cluster contains a research paper published on arXiv discussing the limitations of LLMs in human simulations. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.CL →

• alphaXiv
• arXiv
• CatalyzeX Code Finder for Papers
• CORE Recommender
• DagsHub
• Gotit.pub
• Hugging Face
• Influence Flower
• large-language models
• Qian Wang
• ScienceCast

• paper
• safety

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →