verbalization logprobs

LLM confidence estimates flawed by sparsity, new paper finds

A new research paper published on arXiv highlights significant limitations in how large language models (LLMs) estimate confidence for classification tasks. The study found that common methods like verbalization produce…