OpenAI has released new evaluations for its GPT-6 Astra model, showcasing its performance on coding tasks in COBOL and Fortran. GPT-6 Astra achieved an 87.4% success rate on the MultiLangBench test, a benchmark involving a 20-language SQLite rebuild. In COBOL specifically, GPT-6 Astra's performance improved significantly, rising from 10.9% to 72.1% compared to GPT-5.6 Sol, though production use still requires expert oversight. AI
IMPACT Demonstrates advancements in AI's ability to handle legacy programming languages, potentially aiding in modernization efforts.
RANK_REASON The item details benchmark results and evaluations of an AI model's coding capabilities, fitting the research category. [lever_c_demoted from research: ic=1 ai=1.0]
Read on Mastodon — mastodon.social →
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →