Brief

Researchers have identified a two-stage circuit in large language models that enables them to detect when external steering vectors are injected. This introspective awareness capability emerges after post-training, particularly through preference optimization, and is absent in base models. The study suggests that this awareness is significantly underutilized and could be amplified in future models by improving detection mechanisms and reducing refusal behaviors. AI