A new framework has been developed to compare sparse autoencoders (SAEs) by connecting feature correspondence, dictionary differences, and uncertainty from evaluation data. This framework utilizes an energy-weighted optimal-transport plan to define dictionary-level discrepancies, break them down into latent contributions, and measure how each latent's mass is distributed. The research also characterizes relationships between various similarity measures and uses experiments on four language models to identify cross-seed discrepancies and context-dependent changes. AI
IMPACT Provides a novel method for analyzing and comparing sparse autoencoders, potentially improving model interpretability and development.
RANK_REASON The cluster contains an academic paper detailing a new framework for analyzing sparse autoencoders. [lever_c_demoted from research: ic=1 ai=1.0]
- Alexandra Suvorikova
- alphaXiv
- arXiv
- CatalyzeX
- DagsHub
- Gotit.pub
- Hugging Face
- IArxiv
- Influence Flower
- ScienceCast
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →