When Researchers Say Mental Model/Theory of Mind of AI, What Are They Really Talking About?
A new paper from Xiaoyun Yin argues that when researchers discuss AI's "mental models" or "theory of mind," they are often misinterpreting sophisticated pattern matching as genuine cognition. The paper contends that current evaluations, which show LLMs performing well on human cognitive tasks, only demonstrate behavioral mimicry. Yin proposes a shift towards analyzing the interactive dynamics between humans and AI, rather than testing AI in isolation. AI
IMPACT Challenges current benchmarks for AI cognition, suggesting a need for new evaluation frameworks focused on human-AI interaction.