A new report benchmarks six frontier AI models on robot manipulation tasks using the LIBERO-10 benchmark. The study evaluated GPT-6 Astra, GPT-6.1 Sol, GPT-6 Luna, Claude Opus-5, Claude Opus 5.5, and Gemini-4 Argon. GPT-6 Astra achieved the highest success rate at 44%, closely followed by Gemini-4 Argon at 43%. The research indicates that while increasing reasoning effort can improve performance, models still struggle with complex multi-step interactions and precise spatial arrangements, highlighting the challenges in translating AI reasoning into physical actions. AI
IMPACT Highlights the current limitations of frontier AI models in translating reasoning into reliable physical actions for robot manipulation.
RANK_REASON The cluster reports on a research paper benchmarking AI models on a robotics task.
Read on Hugging Face Daily Papers →
AI-generated summary · Google Gemini · from 2 sources. How we write summaries →