arXiv:2605.13841v2 Announce Type: replace-cross Abstract: Voice agents, artificial intelligence systems that conduct spoken conversations to complete tasks, are increasingly deployed across enterprise applications. However, no existing benchmark jointly addresses two core evaluat…
arXiv cs.AI
TIER_1English(EN)·Haechan Kim, Seungjun Chung, Inkyu Park, Jihoo Lee, Jonghyun Lee·
arXiv:2605.27984v1 Announce Type: cross Abstract: Speech language models (SpeechLMs) have achieved substantial progress by extending large language models (LLMs) to the speech modality. However, SpeechLM evaluation remains heavily centered on English, limiting reliable assessment…
Speech language models (SpeechLMs) have achieved substantial progress by extending large language models (LLMs) to the speech modality. However, SpeechLM evaluation remains heavily centered on English, limiting reliable assessment of multilingual speech capabilities. Straightforw…
Build real-time voice agents on Together AI with co-located STT, LLM, and TTS infrastructure, native Deepgram and Cartesia support, and end-to-end latency under 500ms.
Together AI launches the fastest voice AI stack: streaming Whisper STT, serverless open-source TTS (Orpheus & Kokoro), and Voxtral transcription. Sub-second latency for production voice agents.
How AssemblyAI's unified Voice Agent API differs from multi-vendor voice stacks — one WebSocket, one bill, a small event surface, and a coding-agent-first build experience.
Word error rate doesn't predict voice agent quality. Learn why entity accuracy — on names, account numbers, and medication names — is the metric that matters, and how transcription errors compound across every conversation turn.
The three production ceilings voice agent builders hit after shipping, from accents to compliance to noisy environments, and how to break through each one.
A typical voice agent stack has four vendors, four dashboards, four invoices, and four failure surfaces. Here's what that actually costs in engineering time — and what a collapsed stack changes.
Building a voice agent isn't the hard part. The invisible work between idea and working product is. We mapped the full DIY route and the single-API path so developers can choose with accurate information.
A technical tour of every stage in the Voice Agent API pipeline — STT, turn detection, LLM gateway, TTS, and more — for developers who want transparency before trust.
<h3>I Built a Voice Agent on OpenAI’s Realtime API. The Voices Sounded Robotic. Here’s the Hybrid Stack That Fixed It.</h3><h4>OpenAI for reasoning, ElevenLabs for voice, Twilio for transport — and a single config flag (output_modalities: ["text"]) that ties the whole t…
