XYBench

New benchmark reveals LLMs struggle with user misconceptions

Researchers have introduced XYBench, a new benchmark designed to evaluate Large Language Models' (LLMs) ability to handle queries containing misconceptions, a common issue known as the XY-problem. The benchmark comprise…