PulseAugur
EN
LIVE 07:40:24

Aggregation with Exponential Weights estimator proven optimal in expectation

A new paper published on arXiv introduces the Aggregation with Exponential Weights (AEW) estimator, settling a long-standing open problem regarding its optimality in expectation for model selection aggregation with squared loss. The research demonstrates that AEW achieves the optimal excess risk under specific conditions related to temperature, number of dictionary elements, and sample size, without requiring a Bernstein-type assumption. This finding reveals a sharp phase transition for AEW's performance based on temperature, as previously conjectured. AI

IMPACT Provides theoretical guarantees for a model aggregation technique, potentially influencing future research in robust machine learning.

RANK_REASON Academic paper published on arXiv detailing theoretical findings in statistical learning. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv stat.ML →

AI-generated summary · Google Gemini · from 2 sources. How we write summaries →

Aggregation with Exponential Weights estimator proven optimal in expectation

COVERAGE [2]

  1. arXiv stat.ML TIER_1 English(EN) · Mikael M{\o}ller H{\o}gsgaard, Patrick Rebeschini, Tobias Wegel ·

    Aggregation with Exponential Weights is Optimal in Expectation

    arXiv:2607.02247v1 Announce Type: cross Abstract: The aggregation with exponential weights (AEW) estimator is not fully understood in the basic setting of model selection aggregation with squared loss. In particular, whether it is minimax-rate optimal in expectation for large eno…

  2. arXiv stat.ML TIER_1 English(EN) · Tobias Wegel ·

    Aggregation with Exponential Weights is Optimal in Expectation

    The aggregation with exponential weights (AEW) estimator is not fully understood in the basic setting of model selection aggregation with squared loss. In particular, whether it is minimax-rate optimal in expectation for large enough fixed temperatures and under random design has…