Algebraic Machine Learning for Small-to-Medium Datasets Is Competitive against Strong Standard Baselines
Researchers have developed a new framework called Algebraic Machine Learning (AML) that learns through algebraic structure decomposition, bypassing traditional numerical optimization. In evaluations, AML demonstrated competitive performance against established methods like Convolutional Neural Networks (CNNs) and XGBoost on small to medium-sized image and tabular datasets. Notably, AML achieved this without requiring validation or cross-validation, relying instead on a generic algebraic inductive bias rather than modality-specific biases. AI
IMPACT This research introduces a novel approach to machine learning that could offer an alternative to traditional optimization methods, particularly for datasets with limited examples.