AggreFact

LLM-as-a-Judge: Verbalized Confidence Outperforms Log-Probabilities on New Models

A new arXiv paper proposes a shift in how Large Language Models (LLMs) are used as judges, suggesting that verbalized confidence is now a more robust scoring mechanism than log-probabilities for post-2025 proprietary mo…