A new report benchmarks six leading AI models, including GPT-6 Astra, Claude Opus 5.5, and Gemini-4 Argon, on robot manipulation tasks using the LIBERO-10 benchmark. The study found that GPT-6 Astra achieved the highest success rate at 44%, closely followed by Gemini-4 Argon at 43%. While increasing reasoning effort generally improved performance, the benefits varied by model and incurred higher inference costs. The research highlights both the potential and current limitations of frontier AI models in translating complex reasoning into reliable physical actions, particularly in tasks requiring precise spatial arrangements and multi-step interactions. AI
IMPACT Highlights the challenges and potential of current frontier AI models for real-world robot manipulation, guiding future research in translating reasoning to action.
RANK_REASON The cluster is based on an academic paper published on arXiv detailing benchmark results of AI models on a robotics task. [lever_c_demoted from research: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →