Researchers have developed Optimizable Model Averaging (OMA), a novel black-box technique for ensembling foundation models. This method learns non-negative weights to combine predictive probabilities from different models without requiring fine-tuning or access to model parameters. OMA aims to improve accuracy and robustness in tasks like text and image classification by addressing the challenge of confidently incorrect models through regularization, offering better performance-calibration trade-offs than standard model output averaging. AI
IMPACT This method could enable more efficient and effective use of diverse foundation models for improved performance on complex tasks.
RANK_REASON The cluster contains an academic paper detailing a new method for model ensembling. [lever_c_demoted from research: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →