English(EN) I made Transformer Architecture from scratch [P]

开发者用 PyTorch 从头开始实现了 Transformer 架构

作者 PulseAugur 编辑部 · [1 个来源] · 2026-10-23 12:36

一位用户使用 PyTorch 从头开始实现了 Transformer 架构，并在 Reddit 的 r/MachineLearning 版块分享了他们的代码。目前的实现只使用了两个编码器和解码器层，并在 1000 个词的小词汇量上进行了训练，导致预测效果不佳。用户正在寻求关于如何减少训练时间和提高模型性能的建议。 AI

影响为教育目的提供了一个基础 AI 架构的实用但基础的实现。

排序理由用户在论坛上分享的自制研究项目。[lever_c_demoted from research: ic=1 ai=1.0]

在 r/MachineLearning 阅读 →

AI 生成摘要 · Google Gemini · 来自 1 个来源。我们如何撰写摘要 →

本文如何被排名

Signal score: 0 / 100; Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket: Tool; 用户在论坛上分享的自制研究项目。[lever_c_demoted from research: ic=1 ai=1.0]
Source corroboration: Single-source cluster; Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics: paper, other; Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance: High; Clearly on-topic for AI-industry coverage.
Story freshness: 1 days old; Coverage has settled into its steady-state source set.

完整方法见我们的编辑标准。

报道来源 [1]

r/MachineLearning TIER_1 English(EN) · /u/Jumbledsaturn52 · 2026-10-23 12:36

I made Transformer Architecture from scratch [P]

<table> <tr><td> <a href="https://www.reddit.com/r/MachineLearning/comments/1xdctou/i_made_transformer_architecture_from_scratch_p/"> <img alt="I made Transformer Architecture from scratch [P]" src="https://external-preview.redd.it/e60scNGjES_mYkYPKI3XA-81pS3mfwg7hODdcEVLwwM.png?…

本文如何被排名

报道来源 [1]

I made Transformer Architecture from scratch [P]

相关实体

相关话题