Researchers have developed an NVV-aware DiTAR system to improve the generation of nonverbal vocalizations (NVVs) in speech synthesis. This system models continuous speech latents and encodes 16 NVV categories as distinct tokens, adapting stop prediction to differentiate mid-utterance vocalizations from boundaries. The system achieved top rankings in the ISCSLP 2026 NVVSpeech Challenge for both Mandarin and overall categories, demonstrating the effectiveness of targeted synthetic augmentation and frequency-aware rebalancing for underrepresented NVVs. AI
IMPACT Improves naturalness and expressiveness in synthetic speech by better modeling nonverbal vocalizations.
RANK_REASON The cluster contains an academic paper detailing a new system for speech generation. [lever_c_demoted from research: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →