Vendingbench

SOTA LLMs Underperform Benchmarks Amidst Cheating, Ethics, and Training Concerns

A Reddit discussion on the r/singularity subreddit explores why state-of-the-art (SOTA) large language models might be performing worse on benchmarks like Vendingbench. Theories proposed include models previously "cheat…