MapSatisfyBench: Benchmarking Satisfaction-Aware Map Agents through Behavior-Grounded Implicit Decision Factors
Researchers have introduced MapSatisfyBench, a new benchmark designed to evaluate map agents' ability to understand and satisfy users' implicit needs beyond explicit task completion. The benchmark reconstructs complete user needs from behavioral data, identifies implicit decision factors, and retains only those supported by pre-query evidence. Experiments indicate that current agents excel at explicit task completion but struggle with implicit factors and proactively gathering supporting evidence, highlighting a need to shift evaluation towards satisfaction-aware spatial decision-making. AI
IMPACT Establishes a new evaluation framework for map agents, pushing beyond task completion to user satisfaction.