PulseAugur
EN
LIVE 20:03:01

New theory defines minimum block width for residual neural networks

Researchers have established new theoretical bounds for the universal approximation capabilities of residual neural networks (ResNets) with an inner width of one. The study demonstrates that for $L^p$ approximation on compact domains, the minimum block width required is $\max\{d_x, d_y\}$, where $d_x$ and $d_y$ are the input and output dimensions, respectively. Furthermore, the paper proves that ResNets with a block width less than $\max\{d_x, d_y\}$ cannot achieve universal approximation, irrespective of their inner width. AI

IMPACT Establishes theoretical limits for residual neural network expressivity, informing future architectural designs.

RANK_REASON The cluster contains a research paper published on arXiv detailing theoretical findings about neural network approximation properties.

Read on arXiv stat.ML →

AI-generated summary · Google Gemini · from 2 sources. How we write summaries →

New theory defines minimum block width for residual neural networks

COVERAGE [2]

  1. arXiv stat.ML TIER_1 English(EN) · Qi Zhou, Xuan Zhou, Xiao-Song Yang ·

    Minimum Block Width for Universal Approximation by Residual Neural Networks with Inner Width One

    arXiv:2607.04597v1 Announce Type: cross Abstract: In this paper, we study the universal approximation property of residual neural networks, and obtain some new results. For input and output dimensions $d_x$ and $d_y$, and LeakyReLU, ReLU, ReLU-like activation functions, the upper…

  2. arXiv stat.ML TIER_1 English(EN) · Xiao-Song Yang ·

    Minimum Block Width for Universal Approximation by Residual Neural Networks with Inner Width One

    In this paper, we study the universal approximation property of residual neural networks, and obtain some new results. For input and output dimensions $d_x$ and $d_y$, and LeakyReLU, ReLU, ReLU-like activation functions, the upper and lower bounds of the block width are establish…