两篇新研究论文探讨了当前用户模拟器在训练AI代理方面的局限性。第一篇论文介绍了Persona Policies (PPol)方法，该方法可以为模拟器生成更逼真、更多样化的用户画像，从而使AI代理在与真实用户交互时更加鲁棒。第二篇论文通过衡量使用用户模拟器训练出的AI助手与真实人类的性能对比，量化了用户模拟器的效用，发现基于真实人类行为的用户模拟器比基于简单角色扮演LLM的用户模拟器能产生显著更好的结果。 AI
影响 通过创建更逼真的训练环境，提高了AI代理的鲁棒性，从而在与真实用户交互时获得更好的性能。
排序理由 两篇学术论文发表在arXiv上，讨论了改进AI代理训练和评估的方法。
AI 生成摘要 · Google Gemini · 来自 2 个来源。 我们如何撰写摘要 →
Large Language Model (LLM) agents are increasingly deployed in settings where they interact with a wide variety of people, including users who are unclear, impatient, or reluctant to share information. However, collecting real interaction data at scale remains expensive. The fiel…
User simulators are increasingly leveraged to build interactive AI assistants, yet how to measure the quality of these simulators remains an open question. In this work, we show how simulator quality can be quantified in terms of its downstream utility: how an LLM assistant train…