On the Geometry and Optimization of Polynomial Convolutional Networks
A new research paper explores the geometric and optimization properties of polynomial convolutional networks, which utilize monomial activation functions. By applying tools from algebraic geometry, the study analyzes the 'neuromanifold' formed by these networks, detailing its dimension, degree, and singularities. The research also provides a formula to estimate the number of critical points encountered during the optimization of a regression loss for large datasets. AI
IMPACT Provides theoretical insights into the structure and optimization of a specific class of neural networks, potentially informing future model design.