PulseAugur
EN
LIVE 17:51:27

New research explores expressive power of weight-space neural networks

By PulseAugur Editorial · [2 sources] ·

Two new research papers explore the theoretical underpinnings of permutation-equivariant networks, a design crucial for models operating directly on the parameters of other neural networks. The first paper establishes a comprehensive theory for the expressivity of weight-space networks, proving universality under certain conditions and demonstrating practical improvements. The second paper mathematically explains the emergence of equivariant structures in neural network weights during training, linking end-to-end equivariance to layerwise equivariance. AI

IMPACT These theoretical advancements could lead to more efficient and powerful neural network designs for tasks involving pre-trained models.

RANK_REASON The cluster contains two academic papers published on arXiv discussing theoretical aspects of neural network architectures.

Read on arXiv cs.LG →

AI-generated summary · Google Gemini · from 2 sources. How we write summaries →

COVERAGE [2]

  1. arXiv cs.LG TIER_1 English(EN) · Adir Dayan, Yam Eitan, Haggai Maron ·

    On the Expressive Power of Permutation-Equivariant Weight-Space Networks

    arXiv:2602.01083v2 Announce Type: replace Abstract: Weight-space learning studies neural architectures that operate directly on the parameters of other neural networks. Motivated by the growing availability of pretrained models, recent work has demonstrated the effectiveness of w…

  2. arXiv cs.LG TIER_1 English(EN) · Vahid Shahverdi, Giovanni Luca Marchetti, Georg B\"okman, Kathl\'en Kohn ·

    Identifiable Equivariant Networks are Layerwise Equivariant

    arXiv:2601.21645v2 Announce Type: replace Abstract: We investigate the relation between end-to-end equivariance and layerwise equivariance in deep neural networks. We prove the following: For a network whose end-to-end function is equivariant with respect to group actions on the …

RELATED ENTITIES

RELATED TOPICS