PulseAugur
实时 00:07:03
English(EN) Dynamic Hyperparameter Importance for Efficient Multi-Objective Optimization

新方法通过集成模型和最坏情况分布分析增强鲁棒优化

研究人员开发了用于分布鲁棒优化(一种考虑数据分布不确定性的技术)的新方法。一种方法是集成分布鲁棒贝叶斯优化(Ensemble Distributionally Robust Bayesian Optimization),它使用模型集成来提高鲁棒性并实现理论上的次线性遗憾界限。另一篇论文介绍了分布鲁棒多目标优化(DR-MOO),其算法在最坏情况分布下最小化目标,从而提高了样本复杂度。此外,还提出了一个用于分布鲁棒学习的框架,以优化一阶方法的超参数,将经典的优化学习与最坏情况最优算法设计统一起来。 AI

影响 鲁棒优化技术的这些进步可能带来更可靠、更具适应性的AI系统,尤其是在数据分布不确定或变化的场景中。

排序理由 arXiv上发表了多篇关于分布鲁棒优化新方法的学术论文。

在 arXiv cs.LG 阅读 →

AI 生成摘要 · Google Gemini · 来自 9 个来源。 我们如何撰写摘要 →

新方法通过集成模型和最坏情况分布分析增强鲁棒优化

报道来源 [9]

  1. arXiv cs.LG TIER_1 English(EN) · Denis Derkach ·

    集成分布鲁棒贝叶斯优化

    We study zeroth-order optimisation under context distributional uncertainty, a setting commonly tackled using Bayesian optimisation (BO). A prevailing strategy to make BO more robust to the complex and noisy nature of data is to employ an ensemble as the surrogate model, thereby …

  2. arXiv cs.LG TIER_1 English(EN) · Yufeng Yang, Fangning Zhuo, Ziyi Chen, Heng Huang, Yi Zhou ·

    分布鲁棒多目标优化

    arXiv:2605.05660v1 Announce Type: new Abstract: Multi-objective optimization (MOO) has received growing attention in applications that require learning under multiple criteria. However, the existing MOO formulations do not explicitly account for distributional shifts in the data.…

  3. arXiv cs.LG TIER_1 English(EN) · Vinit Ranjan, Jisun Park, Bartolomeo Stellato ·

    分布鲁棒学习优化

    arXiv:2605.06585v1 Announce Type: new Abstract: We propose a distributionally robust approach to learning hyperparameters for first-order methods in convex optimization. Given a dataset of problem instances, we minimize a Wasserstein distributionally robust version of the perform…

  4. arXiv cs.LG TIER_1 English(EN) · Bartolomeo Stellato ·

    分布鲁棒学习优化

    We propose a distributionally robust approach to learning hyperparameters for first-order methods in convex optimization. Given a dataset of problem instances, we minimize a Wasserstein distributionally robust version of the performance estimation problem (PEP) over algorithm par…

  5. arXiv cs.LG TIER_1 English(EN) · Daphne Theodorakopoulos, Marcel Wever, Marius Lindauer ·

    面向高效多目标优化的动态超参数重要性

    arXiv:2601.03166v2 Announce Type: replace Abstract: Choosing a suitable ML model is a complex task that can depend on several objectives, e.g., accuracy, fairness, or energy consumption. In practice, this requires trading off multiple, often competing, objectives through multi-ob…

  6. arXiv stat.ML TIER_1 English(EN) · Rafael Oliveira ·

    贝叶斯优化中非线性参数化模型的核方法保证

    arXiv:2605.13160v1 Announce Type: new Abstract: Modern Bayesian optimization and adaptive sampling methods increasingly rely on nonlinear parametric models, yet theoretical guarantees for such models under adaptive data collection remain limited. Existing analyses largely focus o…

  7. arXiv stat.ML TIER_1 English(EN) · Rafael Oliveira ·

    贝叶斯优化中非线性参数化模型的核方法保证

    Modern Bayesian optimization and adaptive sampling methods increasingly rely on nonlinear parametric models, yet theoretical guarantees for such models under adaptive data collection remain limited. Existing analyses largely focus on Gaussian processes, kernel machines, linear mo…

  8. arXiv stat.ML TIER_1 English(EN) · Hany Abdulsamad, Sahel Iqbal, Christian A. Naesseth, Takuo Matsubara, Adrien Corenflos ·

    Maximin 鲁棒贝叶斯实验设计

    arXiv:2603.14094v2 Announce Type: replace Abstract: We address the brittleness of Bayesian experimental design under model misspecification by formulating the problem as a max--min game between the experimenter and an adversarial nature subject to information-theoretic constraint…

  9. arXiv stat.ML TIER_1 English(EN) · Tigran Ramazyan, Denis Derkach ·

    集成分布鲁棒贝叶斯优化

    arXiv:2605.07565v1 Announce Type: cross Abstract: We study zeroth-order optimisation under context distributional uncertainty, a setting commonly tackled using Bayesian optimisation (BO). A prevailing strategy to make BO more robust to the complex and noisy nature of data is to e…