Leonard S. Pleiss

Chess study reveals LLMs struggle with generalization, not memorization

A new research paper published on arXiv uses chess to evaluate the generalization and memorization capabilities of large language models (LLMs). The study found that LLMs, including Claude Opus and Gemini, perform poorl…