Integrating Out, Twice:The Open-System Case That Neural-Network Ensemble Theory Is Missing
A new paper proposes a theoretical framework for understanding neural network ensembles in open systems, drawing parallels to nuclear reaction theory. The research suggests that existing ensemble theories primarily address closed systems, missing a crucial 'open' case where information can irreversibly flow out. The paper introduces a mathematical approach using moments of distributions and Gaussian algebra to analyze this open system, finding that while conserved flux can be tracked, the most useful uncertainty lies in the 'closed' half of the model. AI
IMPACT Proposes a new theoretical lens for understanding model behavior, potentially impacting future research into model interpretability and generalization.