Refusal Heads

New research reveals LLM safety circuit, improving refusal rates

Researchers have identified a multi-stage safety circuit within Large Language Models (LLMs) that governs their ability to refuse harmful content. This circuit comprises Harmful Detection Heads, Safety Neurons, and Refu…