Researchers have developed Ruby-OPD, a novel two-stage framework designed to improve pronunciation accuracy and controllability in Japanese text-to-speech (TTS) systems. This framework addresses the challenges posed by Japanese's unsegmented nature, which mixes Kanji and Kana and features extensive polyphony. The system utilizes Ruby text representations with orthography perturbation to maintain surface forms and target pronunciations, and employs On-Policy Distillation (OPD) on text-only corpora to enhance pronunciation accuracy without requiring paired speech data. On the Joyo-Kanji-Yomi benchmark, Ruby-OPD achieved a 97.13% accuracy rate, demonstrating strong controllability and improved pronunciation. AI
IMPACT Improves TTS capabilities for languages with complex orthography and pronunciation.
RANK_REASON Academic paper detailing a new method for text-to-speech. [lever_c_demoted from research: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →