English(EN) Comparing Continued Pretraining to RAG (accuracy and performance)

RAG 与持续预训练：LLM 知识集成对比

作者 PulseAugur 编辑部 · [3 个来源] · 2026-09-11 19:53

一项关于大型语言模型（LLM）的检索增强生成（RAG）与持续预训练的对比研究，探讨了这两种方法在性能和准确性上的差异。实验涉及 QWEN 3.5 4B 模型，评估了通过持续预训练内化知识的有效性，以及通过 RAG 进行实时推理的效果。研究结果旨在量化每种方法在 LLM 知识集成方面的优势。 AI

影响此次对比有助于开发者理解 LLM 通过预训练内化知识与通过 RAG 进行即时推理之间的权衡。

排序理由该集群讨论了两种 LLM 知识集成方法的对比，以实验和研究结果的形式呈现。

AI 生成摘要 · Google Gemini · 来自 3 个来源。我们如何撰写摘要 →

本文如何被排名

Signal score: 0 / 100; Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket: Research; 该集群讨论了两种 LLM 知识集成方法的对比，以实验和研究结果的形式呈现。
Source corroboration: 3 independent sources; Multiple independent publishers reporting the same story raises confidence that it's real and newsworthy.
Topics: paper, other; Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance: High; Clearly on-topic for AI-industry coverage.
Story freshness: 61 days old; Aged out of breaking-news scoring windows; ranking reflects the durable signal from the full source set.
Coverage growth since scoring: +1 source(s) since last score; New sources have picked up this story since our last re-score. Score will update on the next scoring pass.

完整方法见我们的编辑标准。

dev.to — LLM tag TIER_1 English(EN) · Torgeir · 2026-09-14 18:33

RAG 与 LLM 继续预训练的比较
r/LocalLLaMA TIER_1 English(EN) · /u/funJS · 2026-09-11 19:53

对比持续预训练与 RAG（准确性和性能）

<div class="md"><p>Mostly as a fun experiment I wanted to do a quick comparison of performance and accuracy between a CPT trained QWEN 3.5 4B model and a RAG implementation against the base model.</p> <p>The point of this exercise is mostly to measure the performan…
r/OpenAI TIER_2 English(EN) · /u/funJS · 2026-09-15 17:08

结合 RAG 与 LLM 的持续预训练

<div class="md"><p>For leaning purposes, I ran an experiment where I used Unsloth to train a model on a new domain using continued pretraining. Then to make it more flexible, I added a RAG step to inject dynamic data to augment the stable training data.</p> <p>The …