研究人员开发了 KletterMix，一个用于语言模型的高质量德语预训练新数据集。该语料库是通过将最先进的英语预训练数据集翻译成德语而创建的，并仔细保留了文档结构和主题多样性。评估表明，与在现有德语语料库上训练的模型相比，在 KletterMix 上训练的模型在德语任务上取得了更好的性能。 AI
影响 增强了高质量德语数据的可用性，有望提高德语人工智能应用的性能。
排序理由 该集群包含一篇关于用于语言模型预训练的新数据集的学术论文。
AI 生成摘要 · Google Gemini · 来自 3 个来源。 我们如何撰写摘要 →
完整方法见我们的编辑标准。
arXiv:2606.03773v1 Announce Type: new Abstract: High-quality pretraining data is a central ingredient in modern language models, but German-language resources remain far less developed than their English counterparts: they are often smaller, less carefully curated, weakly documen…
High-quality pretraining data is a central ingredient in modern language models, but German-language resources remain far less developed than their English counterparts: they are often smaller, less carefully curated, weakly documented, and rarely validated through controlled tra…
A high-quality German-language corpus for language model pretraining is introduced through careful translation of an English corpus while preserving document structure and metadata, demonstrating improved downstream performance in German-language tasks.