A new arXiv paper evaluates the conversational abilities of speech models, focusing on their decision-making at conversational pauses. The study found that hosted APIs like GPT Realtime and Gemini 3.1 Flash Live tend to speak at nearly every pause, with latency being the primary factor determining if their responses land within human conversational timing. Full-duplex models such as PersonaPlex and Moshi demonstrated a greater ability to remain silent and interrupt appropriately, mimicking human conversational flow more closely. When tested on factual recall from conversations, hosted models performed better when given text input compared to audio input, and Claude Opus 5.5 was used as a judge for text-based recall. AI
IMPACT This research highlights key differences in conversational flow and recall capabilities between various speech models, informing future development for more natural human-AI interaction.
RANK_REASON The cluster contains a research paper published on arXiv detailing an evaluation of speech models. [lever_c_demoted from research: ic=1 ai=1.0]
- arXiv
- Claude Opus 5.5
- Gemini-3.1-flash-live
- gpt-realtime
- Grok Voice
- Moshi
- PersonaPlex
- Seamless interaction in space
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →