This paper explores the impact of feature standardization on machine learning models trained with finite resources. It analyzes how standardizing rare features affects the learning process and the achievable risks, particularly when using stochastic gradient descent. The research derives optimized risks for both standardized and unscaled training under various conditions, including vanishing prevalence and finite observation budgets, and examines how noise and budget influence the choice between standardization and no scaling. AI
IMPACT Provides theoretical insights into optimizing machine learning training under resource constraints.
RANK_REASON The item is a research paper published on arXiv concerning machine learning techniques. [lever_c_demoted from research: ic=1 ai=1.0]
- alphaXiv
- arXiv
- CatalyzeX
- DagsHub
- Gotit.pub
- Hugging Face
- Influence Flower
- ScienceCast
- stat.ML
- stochastic gradient descent
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →