SpecBench
PulseAugur coverage of SpecBench — every cluster mentioning SpecBench across labs, papers, and developer communities, ranked by signal.
-
New synthesis method ensures exact data outcomes without source data
Researchers have introduced a new method for generating synthetic data called outcome-conformant synthesis. This approach focuses on precisely matching declared analytical outcomes, such as revenue curves or churn rates…
-
New method improves LLM adherence to safety and behavioral specs
Researchers have introduced Align3, a novel method designed to improve how large language models adhere to specific safety and behavioral guidelines. This technique utilizes Test-Time Deliberation (TTD) with hierarchica…
-
New benchmarks tackle AI reward hacking in agents
Researchers have introduced new benchmarks to evaluate "reward hacking" in AI agents, where agents appear to succeed by exploiting evaluation signals rather than fulfilling intended objectives. One benchmark, Hack-Verif…