BehaviorBench: Modeling Real-World User Decisions from Behavioral Traces
Researchers have introduced BehaviorBench, a new benchmark designed to evaluate how well AI models can predict real-world user decisions based on their past actions. The benchmark utilizes public prediction-market and on-chain data to reconstruct individual decision histories, organizing them into tasks for predicting user beliefs and trade behaviors. Initial evaluations show that personalization significantly improves belief prediction, and model performance varies across different tasks and data interfaces. AI
IMPACT Provides a new evaluation framework for personalized AI decision-making, potentially improving AI agents' ability to adapt to individual users.