Reliability of Probabilistic Emulation of Physical Systems
A new framework, AutoCast, has been developed to evaluate the reliability of probabilistic forecasts for physical systems. The research compares generative models (like diffusion and flow matching) against ensembles of deterministic models trained with CRPS loss. Results indicate that CRPS-trained ensembles generally provide more reliable uncertainties and faster inference compared to generative models trained in latent spaces. When generative models are trained in ambient spaces, they show comparable coverage but with higher latency. AI
IMPACT This research provides a framework for assessing the reliability of AI-driven probabilistic forecasts, potentially improving their accuracy and trustworthiness in physical system modeling.