A Rigorous, Tractable Measure of Model Complexity
Researchers have developed a new, mathematically sound, and computationally efficient method for measuring model complexity. This approach, based on analyzing similarities in model gradients across different inputs, is applicable to a wide range of models, including parametric, non-parametric, and kernel-based types. The proposed measure unifies and generalizes existing complexity metrics for various models like decision trees and neural networks, offering new insights into phenomena such as double descent. AI
IMPACT Provides a unified and tractable method for assessing model complexity, aiding in interpretation, generalization, and model selection across various AI architectures.