New Quantile-based SGD method enhances outlier robustness in optimization

Researchers have introduced Quantile-k-Loss SGD (QkL-SGD), a novel framework for robust optimization in scenarios with corrupted data. This method samples multiple component losses and updates using a quantile-based selection, offering theoretical linear convergence under specific conditions. Experimental results on various regression tasks demonstrate that QkL-SGD, particularly with intermediate quantiles, outperforms standard SGD and min-k-loss methods by providing more informative updates and avoiding the stalling issues seen with min-k-loss. AI

IMPACT Introduces a new optimization technique that could improve the performance and reliability of machine learning models trained on noisy datasets.

RANK_REASON The cluster contains a research paper detailing a new optimization method for machine learning. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.LG →

• arXiv
• Quantile-k-Loss SGD
• SGD

• paper
• other

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →