JudgeBank

FewHumans library improves LLM judge reliability and reduces human labeling costs

A new library called FewHumans has been developed to address the unreliability of LLM judges in evaluating AI model outputs. These judges often overestimate their accuracy, with judge-only intervals missing the true hum…