New metric measures LLM ideological depth and refusal causes

Researchers have introduced a new metric called "ideological depth" to measure the internal political representations within large language models. This metric assesses a model's ability to follow political instructions and the richness of its internal features, using sparse autoencoders for analysis. Experiments on open-weight LLMs revealed that models with greater steerability activated significantly more political features, while others increased refusals, suggesting capability deficits rather than fixed safety rules can cause these refusals. AI

IMPACT Introduces a new framework for understanding and potentially improving LLM behavior on sensitive topics.

RANK_REASON Academic paper introducing a new metric and experimental findings. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.CL →

• Large language models
• Shariar Kabir
• sparse autoencoders

• paper
• safety

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →