CloudCons: A Comprehensive End-to-End Benchmark for Cloud Resource Consolidation
Researchers have introduced CloudCons, a new benchmark designed to evaluate the effectiveness of forecasting models in cloud resource consolidation. Existing benchmarks primarily focus on prediction accuracy, neglecting the practical decision-making utility of models in real-world scenarios. CloudCons utilizes diverse datasets from Huawei Cloud, Azure, and Google Borg to assess various statistical, deep learning, and foundation models. A key finding is that while foundation models excel in zero-shot forecasting accuracy, this does not guarantee improved decision utility for resource consolidation. AI