A new research paper explores the concept of symmetry within trained neural networks, investigating whether learned symmetries in function space can be translated to parameter space. The study proposes a method using parameter-wise functional sensitivity to identify directions that realize group actions in function space. Findings indicate that while these directions can induce predicted function-space motion locally, they may diverge after training, suggesting a complex relationship between parameterization and learned symmetries. AI
IMPACT This research could lead to a deeper understanding of how neural networks learn and represent symmetries, potentially influencing future model architectures and training methodologies.
RANK_REASON The cluster contains a single academic paper published on arXiv. [lever_c_demoted from research: ic=1 ai=1.0]
- arXiv
- Hugging Face
- machine learning
- Parameter-Level Attribution of Symmetry in Trained Networks Though Parameter-Wise Functional Sensitivity
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →