研究人员推出了DunbaaBERT，这是一系列新的乌尔都语RoBERTa-base模型，旨在解决乌尔都语在NLP任务中探索不足的问题。这些模型在一个包含不同Byte-BPE词汇大小的17GB乌尔都语语料库上进行训练，在与多语言基线模型相比时表现出竞争力，同时提供了有利的效率。值得注意的是，研究发现更大的词汇量并未持续提高下游任务的有效性，其中32k词汇量变体显示出最佳的效率特征。这些模型已根据MIT许可证发布，旨在提供具有紧凑规模的、具有竞争力的乌尔都语特定编码器模型。 AI
影响 为乌尔都语NLP引入了专门的模型，有可能提高该语言任务的性能和效率。
排序理由 该集群描述了一篇详细介绍特定语言语言模型创建和评估的新学术论文，符合研究类别。
AI 生成摘要 · Google Gemini · 来自 3 个来源。 我们如何撰写摘要 →
完整方法见我们的编辑标准。
arXiv:2605.26935v1 Announce Type: new Abstract: Large language models have achieved strong performance across many NLP tasks, yet Urdu remains comparatively underexplored due to limited resources and fragmented evaluation settings. To address this gap, we introduce DunbaaBERT, a …
Large language models have achieved strong performance across many NLP tasks, yet Urdu remains comparatively underexplored due to limited resources and fragmented evaluation settings. To address this gap, we introduce DunbaaBERT, a family of Urdu RoBERTa-base models trained from …
Large language models have achieved strong performance across many NLP tasks, yet Urdu remains comparatively underexplored due to limited resources and fragmented evaluation settings. To address this gap, we introduce DunbaaBERT, a family of Urdu RoBERTa-base models trained from …