Two new research papers introduce novel methods for steering large language models to suppress undesired behaviors. GAPS (Gated Activation steering via Posterior and Separability) employs dimension-level gates to selectively apply steering vectors to specific neurons, improving toxicity mitigation on models like Gemma-3 and Qwen-3. IDEEA (Input-Dependent stEEring via Activation cluster matching) offers an input-dependent steering framework that clusters activation supports to construct tailored steering directions, significantly enhancing performance on benchmarks like TruthfulQA. AI
IMPACT These new steering techniques could lead to more controllable and safer large language models, reducing harmful outputs and improving performance on specific tasks.
RANK_REASON Two academic papers published on arXiv introducing new methods for LLM steering.
Read on Hugging Face Daily Papers →
AI-generated summary · Google Gemini · from 4 sources. How we write summaries →