AlgoBench

New benchmark AlgoBench tests LLMs' algorithmic reasoning beyond memorization

Researchers have developed AlgoBench, a new framework designed to evaluate the algorithmic reasoning capabilities of code generation models. Unlike traditional benchmarks that can be compromised by training data exposur…