Remez exchange

New SAE Methods Enhance Interpretability and Feature Learning

Researchers have introduced novel approaches to enhance Sparse Autoencoders (SAEs), a tool for interpreting neural network activations. One method, the Rational Sparse Autoencoder (RSAE), replaces fixed activation funct…