A new benchmark called IHBench has been developed to evaluate how well voice agents recover from user interruptions within structured workflows. The benchmark assesses task fulfillment and recovery quality across ten enterprise domains and six interruption types. Evaluations of 27 audio-language model configurations revealed that closed-weight models, such as those from OpenAI and Google, generally outperform open-weight models in handling interruptions, degrading more slowly over longer conversations and showing no modality gap. AI
IMPACT This benchmark could drive improvements in the robustness and usability of voice agents in enterprise settings.
RANK_REASON The cluster describes a new academic benchmark for evaluating AI capabilities. [lever_c_demoted from research: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →
