PulseAugur
EN
LIVE 09:18:52

RepNet tackles spectral bias in deep neural networks

Researchers have introduced RepNet, a novel deep neural network architecture designed to address spectral bias, a common limitation in capturing high-frequency and oscillatory behaviors. By reparameterizing the weights and biases in the first hidden layer, RepNet effectively controls the initial slope scale and distribution of partition points. This adaptive frequency scaling during training allows RepNet to improve accuracy in approximating complex functions and solving PDE problems, particularly when combined with physics-informed neural networks, with only a marginal increase in computational cost. AI

IMPACT RepNet offers a new method for improving the accuracy of deep neural networks in capturing high-frequency data, potentially benefiting scientific computing and complex system modeling.

RANK_REASON The cluster contains an academic paper describing a new model architecture.

Read on arXiv cs.LG →

AI-generated summary · Google Gemini · from 2 sources. How we write summaries →

COVERAGE [2]

  1. arXiv cs.LG TIER_1 English(EN) · Yong Wang, Tao Zhou, Xuhui Meng ·

    RepNet: Tackling spectral bias in deep neural networks via parameter reparameterization

    arXiv:2606.16575v1 Announce Type: new Abstract: Deep neural networks (DNNs) have achieved remarkable success in scientific computing, yet they often suffer from spectral bias in capturing oscillatory and multiscale behaviors. In this study, we investigate this limitation by exami…

  2. arXiv cs.LG TIER_1 English(EN) · Xuhui Meng ·

    RepNet: Tackling spectral bias in deep neural networks via parameter reparameterization

    Deep neural networks (DNNs) have achieved remarkable success in scientific computing, yet they often suffer from spectral bias in capturing oscillatory and multiscale behaviors. In this study, we investigate this limitation by examining the failure of shallow ReLU neural networks…