Machine Psychometrics: A Mathematical Psychology of Artificial Intelligence
A new paper proposes "Machine Psychometrics" as a framework for evaluating artificial intelligence, moving beyond simple capability scores. This approach uses mathematical psychology methods to create detailed "Machine Mindprints" that profile an agent's latent dispositions like calibration, suggestibility resistance, and expressive alignment. The goal is to understand AI behavior precisely because it differs from human cognition, enabling informed deployment decisions through a "Trust Protocol." AI
IMPACT Introduces a novel measurement science for AI, aiming to provide a more nuanced understanding of agent behavior beyond capability scores.