Shen Zhou Hong

AI evaluation studies face validity challenges, paper finds

A new paper published on arXiv details methodological challenges in evaluating frontier AI systems through human uplift studies. These studies, which use randomized controlled trials to measure AI's impact on human perf…