Unsupervised AI models can learn sensitive attributes, violating fairness

Researchers have demonstrated that unsupervised machine learning representations can inadvertently encode sensitive attributes like age and income, even when these attributes are excluded from the training data. A new method called SOMtime, based on Self-Organizing Maps, showed that these sensitive attributes emerged as dominant latent axes in embeddings, achieving high correlations with withheld data. This indicates that the "fairness through unawareness" approach is insufficient at the representation level, necessitating fairness audits for unsupervised components of ML pipelines. AI

IMPACT Highlights the failure of 'fairness through unawareness' in unsupervised learning, necessitating new auditing methods for AI pipelines.

RANK_REASON The cluster contains an academic paper detailing a new research finding about AI fairness. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.AI →

• autoencoder
• Census-Income dataset
• Joseph Bingham
• principal component analysis
• SOMtime
• t-Distributed Stochastic Neighbor Embedding
• Uniform Manifold Approximation and Projection
• World Values Survey

• paper
• safety

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →