evalplus
PulseAugur coverage of evalplus — every cluster mentioning evalplus across labs, papers, and developer communities, ranked by signal.
1 day(s) with sentiment data
-
New framework proposes independent verification for AI-generated software
This paper introduces a framework for independently verifying software produced by AI coding agents. The authors argue that when an AI system generates both the software and its tests, the tests lack independent assuran…
-
LLM benchmarks saturate quickly due to training data contamination
Public LLM benchmarks are becoming saturated and less useful for differentiating top-tier models due to their training data inadvertently including benchmark questions. This contamination issue, observed in benchmarks l…
-
IBM's new 8B Granite 4.1 model outperforms older 32B MoE version
IBM has released Granite 4.1, a family of open-source language models designed for enterprise use, featuring three sizes (3B, 8B, and 30B parameters). Notably, the 8B dense model demonstrates performance matching or exc…