English(EN) When Thoughts Become Memory: Unifying In-Context Learning and Fine-Tuning

新定律统一了人工智能模型的上下文学习和微调

作者 PulseAugur 编辑部 · [1 个来源] · 2026-10-22 04:00

研究人员开发了一种新颖的方法来确定新数据是应纳入预训练模型的上下文还是其权重。该方法基于其信息价值的精确定律，该价值根据在保留查询上节省的代码长度计算得出。该定律提供了从单一测量中认证选择的上限，以及用于连续验证的随时有效的测试，从而在过程停止时控制错误。该方法已成功应用于各种模型，包括 transformers、TabPFN 和 GPT-2，证明了其在优化数据集成以提高性能方面的有效性。 AI

影响为优化人工智能模型的数据集成提供了理论框架，有可能提高效率和性能。

排序理由该集群包含一篇详细介绍人工智能模型新理论框架和实验验证的学术论文。[lever_c_demoted from research: ic=1 ai=1.0]

在 arXiv cs.LG 阅读 →

AI 生成摘要 · Google Gemini · 来自 1 个来源。我们如何撰写摘要 →

本文如何被排名

Signal score: 1 / 100; Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket: Tool; 该集群包含一篇详细介绍人工智能模型新理论框架和实验验证的学术论文。[lever_c_demoted from research: ic=1 ai=1.0]
Source corroboration: Single-source cluster; Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics: paper, model release; Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance: High; Clearly on-topic for AI-industry coverage.
Story freshness: 1 days old; Coverage has settled into its steady-state source set.

完整方法见我们的编辑标准。

报道来源 [1]

arXiv cs.LG TIER_1 English(EN) · Leon Chlon, Julie Huang · 2026-10-22 04:00

When Thoughts Become Memory: Unifying In-Context Learning and Fine-Tuning

arXiv:2610.29419v1 Announce Type: cross Abstract: We are the first to give a certified rule for whether unseen data belong in a pretrained model's context or its weights, built on an exact law for their information value. That value, the code length saved on held-out queries, equ…

本文如何被排名

报道来源 [1]

When Thoughts Become Memory: Unifying In-Context Learning and Fine-Tuning

相关实体

相关话题