A new research paper published on arXiv explores model selection techniques for probabilistic time series forecasting. The study highlights how different aggregation methods, such as mean score, median score, and mean rank, can lead to conflicting conclusions due to score distribution skewness. It demonstrates that larger test sets help these selection criteria converge, but for shorter test sets, only the mean score reliably identifies the true model. The paper illustrates these findings using intermittent time series, including data from the M5 competition, emphasizing the critical role of adequate test set size. AI
IMPACT Provides insights into improving the reliability of model selection for time series forecasting, particularly with limited data.
RANK_REASON Research paper published on arXiv detailing statistical methods for model selection in time series.
AI-generated summary · Google Gemini · from 3 sources. How we write summaries →