PulseAugur
中
实时 04:14:54
English(EN) I trained a 348M model trained from scratch on 22.7B tokens that does 14 digit arithmetic [P]

348M参数模型通过展示计算过程掌握14位数算术

一位开发者训练了一个拥有3.48亿参数的语言模型,使用了227亿个token,该模型展现了高级算术能力。在GPT-3算术基准测试中,该模型准确率达到99.4%,并且可以通过展示计算过程执行多达14位数的运算,相比之前的模型有了显著提升。这种性能的提升归因于模型能够学习并将其训练数据之外的数位命名约定进行扩展。 AI

影响 展示了改进的词汇量和数据如何显著增强模型的算术推理能力,可能影响未来的模型训练策略。

排序理由 该集群描述了一个自定义训练的语言模型,在算术任务上具有特定的性能指标,符合研究类别。[lever_c_降级自研究: ic=1 ai=1.0]

在 r/MachineLearning 阅读 →

AI 生成摘要 · Google Gemini · 来自 1 个来源。 我们如何撰写摘要 →

348M参数模型通过展示计算过程掌握14位数算术

本文如何被排名

Signal score
0 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Tool
该集群描述了一个自定义训练的语言模型,在算术任务上具有特定的性能指标,符合研究类别。[lever_c_降级自研究: ic=1 ai=1.0]
Source corroboration
Single-source cluster
Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics
model release, product
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
28 days old
Aged out of breaking-news scoring windows; ranking reflects the durable signal from the full source set.

完整方法见我们的编辑标准。

报道来源 [1]

  1. r/MachineLearning TIER_1 English(EN) · /u/nkthebass ·

    我从头开始训练了一个348M模型,使用了22.7B个token,可以进行14位数算术运算 [P]

    <!-- SC_OFF --><div class="md"><p>Hello this is my fifth small language model I've made and apart of my third series and it has been a lot of work but it payed off: **348M parameters, 22.7B tokens**, then fine-tuned into a math model that solves arithmetic by *showing the work* —…