Be Fair! Can Machine Learning Engineering Agents Adhere to Fairness Constraints?
A new research paper explores the fairness constraints of machine learning engineering agents, which automate ML pipeline development. The study found that current agents exhibit high variance and underperform manual baselines in predictive quality and fairness, even with fairness-oriented prompts. The authors propose a responsibility-centered evaluation framework and suggest that future MLE agents need redesign to better enable human guidance and compliance assessment. AI
IMPACT Highlights potential risks in automated ML development, urging caution for sensitive applications and guiding future research towards more controllable agents.