Bi-Jump-ReLU

New Sparse Autoencoder Model Enhances LLM Feature Interpretability

Researchers have introduced the Sign-Aware Gated Sparse Autoencoder (SA-GSAE), a novel architecture designed to improve the interpretability of features extracted from Large Language Models. Unlike standard SAEs that en…