GDPval
PulseAugur coverage of GDPval — every cluster mentioning GDPval across labs, papers, and developer communities, ranked by signal.
1 day(s) with sentiment data
-
Language models show stable preferences for 'leisure' and aversion to tedium
A new paper published on arXiv details experiments testing the revealed preferences of 20 language models. The study found that models exhibit stable dispositions towards certain tasks, demonstrating tedium aversion, a …
-
New GDPevo benchmark measures AI agent self-evolution
A new benchmark called GDPevo has been developed to measure the self-evolutionary capabilities of AI agents. This benchmark addresses the challenge of evaluating how effectively agents learn from experience and improve …
-
New framework aims to improve AI benchmarks for knowledge work
A new paper proposes a three-step framework for designing and reporting benchmarks for AI systems intended for knowledge work. The approach emphasizes clearly defining the work activity, specifying the testing environme…