Medley Metacognition Score

New benchmark MEDLEY-BENCH tests LLM belief revision under social pressure

Researchers have introduced MEDLEY-BENCH, a new benchmark designed to evaluate how large language models revise their beliefs when presented with conflicting evidence or social pressure. Unlike benchmarks that focus sol…