PulseAugur
EN
LIVE 09:31:25
ENTITY OracleBench

OracleBench

PulseAugur coverage of OracleBench — every cluster mentioning OracleBench across labs, papers, and developer communities, ranked by signal.

Show in brief
Total · 30d
2
2 over 90d
Releases · 30d
0
0 over 90d
Papers · 30d
0
0 over 90d
TIER MIX · 90D
TOPICS
RECENT · PAGE 1/1 · 2 TOTAL
  1. TOOL · CL_309055 ·

    FewHumans library improves LLM judge reliability and reduces human labeling costs

    A new library called FewHumans has been developed to address the unreliability of LLM judges in evaluating AI model outputs. These judges often overestimate their accuracy, with judge-only intervals missing the true hum…

  2. TOOL · CL_285725 ·

    Small LLM judges show high error rates and biases in new evaluation

    A recent analysis evaluated the performance of small, open-source LLM judges, specifically Qwen2.5-3B and Qwen2.5-0.5B, against deterministic oracles for tasks like legal clause identification and arithmetic. The study …