NagaTranslate builds low-resource language pipeline using LLMs, Whisper, VITS

A project called NagaTranslate is developing a translation and speech pipeline for low-resource languages in Nagaland, India, including Nagamese, Ao, and Sema. The system utilizes a commercial LLM API for text translation, a fine-tuned VITS model for speech synthesis, and a fine-tuned Whisper model for speech recognition. The developer is seeking advice on self-hosting open-weight models, handling spelling variations in Nagamese, and improving TTS/ASR robustness to regional accents with limited data. AI

IMPACT This project demonstrates the application of LLMs, Whisper, and VITS for low-resource language processing, potentially paving the way for similar initiatives.

RANK_REASON The item describes a technical project focused on building NLP tools for low-resource languages, detailing the architecture and models used. [lever_c_demoted from research: ic=1 ai=1.0]

Read on r/MachineLearning →

• Gemma
• Llama
• Nagaland
• NagaTranslate
• NLLB
• Vits
• Whisper

• product
• model release

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →