Smolensky

Language Model Neurons Found to Be Sparse, Aiding Interpretability

Researchers have demonstrated that the neurons within a language model's MLP layers exhibit a degree of sparsity comparable to that of Sparse Autoencoders (SAEs). This finding enables the development of a gradient-based…