New model maps speech directly to robot actions, cutting latency

Researchers have developed Speech-$\pi_{0.5}$, a novel audio-language-action model that directly maps raw speech to robotic motor commands, bypassing the need for explicit text transcriptions. This approach significantly reduces response latency by approximately three times compared to traditional methods that use automatic speech recognition pipelines. The model, built upon $\pi_{0.5}$ and trained in two stages with split LoRA adaptation, demonstrates competitive task success on the LIBERO benchmark and shows robust generalization to unseen accents. AI

IMPACT This development could accelerate the adoption of voice-controlled robotics by reducing latency and improving natural language interaction.

RANK_REASON The item describes a new research paper detailing a novel model for robotic manipulation. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.CV →

• arXiv
• DagsHub
• Hugging Face
• LIBERO
• $\pi_{0.5}$
• Speech-$\pi_{0.5}$

• paper
• model release
• infra

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →