English(EN) Transformers are famously bad at arithmetic, so I set one's weights by hand (no training) and it multiplies with 100% accuracy [P]

Transformer 模型通过手动设置权重实现 100% 的乘法准确率

作者 PulseAugur 编辑部 · [1 个来源] · 2026-08-10 17:37

一位开发者手动设置了一个 Transformer 模型的权重以执行乘法运算，在没有经过任何训练的情况下，对三位数计算实现了 100% 的准确率。这种方法绕过了标准 Transformer 在算术任务上的已知局限性。开发者创建了四个模型版本，每个版本采用不同的计算策略，并发布了检查点供他人使用。 AI

影响通过探索直接权重调整而非标准训练方法，为提高 LLM 在特定任务上的性能指明了一个潜在方向。

排序理由通过直接操纵权重绕过传统训练，展示了一种在 Transformer 模型中实现算术任务高准确率的新颖方法。[lever_c_demoted from research: ic=1 ai=1.0]

在 r/MachineLearning 阅读 →

AI 生成摘要 · Google Gemini · 来自 1 个来源。我们如何撰写摘要 →

本文如何被排名

Signal score: 0 / 100; Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket: Tool; 通过直接操纵权重绕过传统训练，展示了一种在 Transformer 模型中实现算术任务高准确率的新颖方法。[lever_c_demoted from research: ic=1 ai=1.0]
Source corroboration: Single-source cluster; Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics: model release, other; Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance: High; Clearly on-topic for AI-industry coverage.
Story freshness: 59 days old; Aged out of breaking-news scoring windows; ranking reflects the durable signal from the full source set.

完整方法见我们的编辑标准。

报道来源 [1]

r/MachineLearning TIER_1 English(EN) · /u/notforrob · 2026-08-10 17:37

Transformer模型以算术能力差而闻名，所以我手动设置了一个模型的权重（无需训练），它的乘法准确率达到了100% [P]

<div class="md"><p>Obviously nobody needs a transformer that's good at multiplication. I wanted to know whether a stock transformer could do exact arithmetic if I chose its weights directly.</p> <p>I implemented the grade-school algorithm as a computation graph and…

本文如何被排名

报道来源 [1]

Transformer模型以算术能力差而闻名，所以我手动设置了一个模型的权重（无需训练），它的乘法准确率达到了100% [P]

相关实体

相关话题