RM-Bench
PulseAugur coverage of RM-Bench — every cluster mentioning RM-Bench across labs, papers, and developer communities, ranked by signal.
1 day(s) with sentiment data
-
New framework DeCert improves AI reward model justifications
Researchers have introduced DeCert, a new framework designed to improve generative reward models (GenRMs) by focusing on the quality of their justifications, not just the accuracy of their verdicts. DeCert evaluates the…
-
Open Contrastive Decision Model Fails Public LLM Judge Benchmarks
A new research paper introduces Contrastive-LM/CLM-v0.1-8B, an open contrastive decision model designed for evaluating large language models. However, the model performed poorly on several public benchmarks, scoring nea…
-
New 'patterning' technique debiases AI reward models, shows cross-model transfer
Researchers have developed a new technique called "patterning" to debias reward models used in AI training. This method reweights preference pairs based on their impact on benchmark losses, effectively reducing stylisti…
-
AdaJudge framework improves LLM reward modeling with adaptive pooling
Researchers have introduced AdaJudge, a novel framework designed to enhance the accuracy of reward modeling in large language models. This approach tackles limitations in current static pooling strategies by adapting bo…
-
New SVR framework improves LLM evaluation by learning discriminative rubrics
Researchers have developed a new framework called Support Vector Rubrics (SVR) to improve the evaluation of large language model outputs. SVR addresses the limitation of self-generated rubrics by focusing on discriminat…