Viacheslav Yusupov

Study finds geometric LLM metrics unreliable, but useful for failure detection

Researchers have conducted a comprehensive stress-test of geometric metrics used for evaluating Large Language Models (LLMs). Their analysis revealed that some metrics, like Schatten Norm and MOM, primarily reflect outp…