New Bangla translation system bridges 12 regional dialects

Researchers have developed a novel Poly-Dialectal Neural Machine Translation System designed to address the significant challenge of dialectal variation in Bangla. This system can translate between 12 regional Bangla dialects without needing an intermediary standard language. A fine-tuned BanglaT5 model, utilizing Weight-Decomposed Low-Rank Adaptation (DoRA), achieved state-of-the-art performance, outperforming larger models like NLLB-200 and mBART-50. The project also involved compiling the largest multi-dialect parallel corpus for Bangla to date and has released an open-access web application for the optimized model to promote digital inclusion. AI

IMPACT Enhances NLP capabilities for low-resource languages and regional dialects, promoting digital inclusion.

RANK_REASON Academic paper detailing a new NLP system and dataset. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.CL →

• Bangla
• BanglaT5
• Hugging Face
• mBART-50
• Mendeley Data
• NLLB-200
• Poly-Dialectal Neural Machine Translation System
• Standard Colloquial Bangla (SCB)
• Weight-Decomposed Low-Rank Adaptation (DoRA)

• paper
• model release

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →