Researchers, including Turing Award winner Andrew Yao and Moonshot AI founder Yang Zhilin, have developed a new evaluation system called TCSExam to assess AI's capability in genuine mathematical research. This system tests AI agents on 100 theoretical computer science tasks, such as proving theorems and constructing mathematical objects, moving beyond simple problem-solving. Early results show GPT-6 Astra completing 14 out of 20 research-level theorems and advancing a finite field matrix conjecture from 8 to 9 dimensions, demonstrating AI's potential in scientific discovery. AI
IMPACT This new evaluation system could accelerate AI's ability to contribute to theoretical computer science and advanced mathematics research.
RANK_REASON The cluster describes a new evaluation system for AI in mathematical research and presents benchmark results for AI agents on theoretical computer science tasks. [lever_c_demoted from research: ic=1 ai=1.0]
- Andrew Yao
- arXiv
- Chinese Academy of Sciences
- GPT -6 Astra
- Institute for Interdisciplinary Information Sciences
- Kimi k3
- TCSExam
- Tsinghua University
- Turing Award
- Yang Zhilin
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →