Researchers have introduced DexHoldem, a new benchmark designed to evaluate embodied AI systems in real-world dexterous manipulation tasks, specifically within the context of Texas Hold'em poker. The benchmark includes a comprehensive set of 1,470 demonstrations covering 14 manipulation primitives, a standardized physical policy benchmark, and an agentic perception benchmark. Initial results show that the $\pi_{0.5}$ policy achieved the highest task completion rate at 61.2% for primitive execution, while Opus 5.5 narrowly led in agentic perception accuracy. AI
IMPACT This benchmark could accelerate the development of more capable embodied AI agents for complex, real-world tasks.
RANK_REASON The cluster describes a new academic benchmark for AI research. [lever_c_demoted from research: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →