Brian Christian

AI model evaluations need richer toolkits beyond simple scores

Current AI model evaluation methods, primarily relying on benchmarks, are insufficient for accurately assessing both capabilities and safety. These benchmarks suffer from issues like saturation, unreliability, and gamea…