Researchers have developed a new metric, the Weighted Variability Score (WVS), to quantify and predict performance variability in mixed-integer programming (MIP) solvers. This metric aggregates dispersion in runtime, optimality gap, and other factors across repeated runs. Experiments on MIPLIB 2017 instances revealed that while many problems are stable, some exhibit significant variability not explained by simple properties. A predictive model using early-run features achieved a mean absolute error of 0.058, indicating that variability is systematic and can be partially predicted, offering a tool for preemptive tuning and fairer algorithm evaluation. AI
IMPACT This research provides a framework for more reliable evaluation of optimization algorithms, which could indirectly impact AI research that relies on such solvers.
RANK_REASON Academic paper introducing a new metric and predictive model for computational studies. [lever_c_demoted from research: ic=1 ai=0.4]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →