New voice conversion method uses KNN for non-parallel data

Researchers have developed a novel voice conversion framework that uses K-Nearest Neighbors (KNN) retrieval on WavLM representations to align non-parallel speech data. This method constructs synthetic training pairs from non-parallel source and target audio, enabling supervised learning without requiring explicit alignment or parallel corpora. The framework also incorporates a speaker loss to maintain consistent target-speaker identity, demonstrating high naturalness and speaker similarity across multiple languages, even when trained solely on English data. AI

IMPACT This method could enable more accessible and multilingual voice conversion without requiring parallel datasets.

RANK_REASON The cluster contains an academic paper detailing a new method for voice conversion. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.LG →

• K-Nearest Neighbors (KNN)
• WavLM

• paper
• other

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →