PulseAugur
EN
LIVE 09:44:40

Open-source EmpaAva chatbot brings empathetic AI to live 3D avatar interactions

Researchers have introduced EmpaAva, an open-source chatbot that integrates empathetic response generation into live, 3D avatar interactions. This system uses a Tri-Agent Architecture coordinated by a large language model to process user affect from speech and vision, generating replies with emotional speech, synchronized facial movements, and photorealistic rendering. EmpaAva aims to bridge the gap between text-based empathy and real-time, multimodal communication, outperforming text-only and 2D avatar baselines in evaluations. AI

IMPACT This development could advance the realism and emotional intelligence of virtual agents in real-time communication platforms.

RANK_REASON The cluster describes a research paper detailing a new open-source chatbot with novel capabilities. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.CL →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

Open-source EmpaAva chatbot brings empathetic AI to live 3D avatar interactions

COVERAGE [1]

  1. arXiv cs.CL TIER_1 English(EN) · Jie Yang, Wenhao Xu, Shuhui Lin, Hao Fei ·

    EmpaAva: An Open-source Agentic 3D-Avatar Empathetic Live Chatbot

    arXiv:2608.04709v1 Announce Type: new Abstract: This paper presents EmpaAva, to our knowledge the first open-source, agentic 3D-avatar empathetic chatbot, which carries empathetic response generation (ERG) from text-only exchanges into live, face-to-face interaction. Through a vi…