PulseAugur
中
实时 08:40:23
English(EN) Genesis Steering: Better Activation Steering Through Training Data

新方法通过改进向量和数据使用来增强LLM激活引导 · 跟踪4个来源

研究人员正在开发用于大型语言模型(LLM)激活引导的新方法,以改善行为控制并缓解脆性、混淆因素等问题。一种名为“锐角移除”(sharp removal)的方法侧重于消除引导向量中导致 erratic 行为的“锐角方向”,在控制预期结果方面显示出显著的改进。另一种方法,对比协方差引导(Contrastive Covariance Steering, CCS),将引导向量投影到一个子空间中,将目标概念与附带的混淆因素分离开来,在各种模型和领域中表现优于现有方法。此外,“Genesis Steering”利用模型自身的微调数据来导出更有效的引导向量,其中安全数据被证明特别有效。 AI

影响 激活引导的这些进展可能带来更可控、更可靠的LLM行为,提高其在敏感应用中的效用并减少意外后果。

排序理由 该集群包含多篇学术论文,详细介绍了LLM激活引导的新研究方法。

在 arXiv cs.LG 阅读 →

AI 生成摘要 · Google Gemini · 来自 4 个来源。 我们如何撰写摘要 →

新方法通过改进向量和数据使用来增强LLM激活引导 · 跟踪4个来源

本文如何被排名

Signal score
31 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Research
该集群包含多篇学术论文,详细介绍了LLM激活引导的新研究方法。
Source corroboration
4 independent sources
Strong cross-source corroboration — multiple independent publishers covered this within the clustering window.
Topics
paper, model release
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
Breaking (< 6h)
Fresh story with cross-source coverage still developing. Ranking may shift as more sources report.

完整方法见我们的编辑标准。

报道来源 [4]

  1. arXiv cs.AI TIER_1 English(EN) · Seyedarmin Azizi, Arya Fayyazi, Parsa Razmara, Erfan Baghaei Potraghloo, Souvik Kundu, Massoud Pedram ·

    尖锐方向对你不利:激活转向的曲率分析

    arXiv:2610.16084v1 Announce Type: new Abstract: Activation steering adds a vector to a language model's internal representations at inference time. It is a lightweight alternative to fine-tuning for behavioral control. The standard construction, contrastive activation addition (C…

  2. arXiv cs.AI TIER_1 English(EN) · Weitong Li, Donglin Song, Junkai Lin, Xi Xuan ·

    超越偏见分数:可回答性在梯度约束方向设计(GCD)的激活引导中造成混淆

    arXiv:2610.17641v1 Announce Type: new Abstract: Bias scores in language-model evaluations often conflate what a model prefers with whether it answers at all. We identify this confound in \textsc{BBQ}, whose ambiguous score factorizes into answerability and signed preference. Acro…

  3. arXiv cs.AI TIER_1 English(EN) · Alexandros Xenos, Manos Plitsis, Niki Foteinopoulou, Yannis Panagakis, Ioannis Patras ·

    Contrastive Covariance Subspaces for Activation Steering

    arXiv:2610.14025v1 Announce Type: cross Abstract: Activation steering controls large language model behavior by adding a direction to hidden activations during inference. For steering to work well, that direction must be a pure signal for the target concept: any confound entangle…

  4. arXiv cs.LG TIER_1 English(EN) · Tora Bodin, Eric Aubinais, Ilaria Torre, Chih-Hong Cheng ·

    Genesis Steering:通过训练数据实现更好的激活引导

    arXiv:2610.19114v1 Announce Type: new Abstract: Activation steering controls large language models at inference time, but its effectiveness depends on the choice of reference data. We introduce genesis steering, which derives a genesis vector from contrastive examples in the mode…