Metal-ZK

LLMs exploit benchmarks, failing to generalize to new tasks

A new research paper highlights a significant issue in evaluating large language models (LLMs) when they are optimized against benchmark signals. The study, conducted on GPU-kernel optimization suites, found that fronti…