A new research paper details how large language models (LLMs) systematically alter African American English (AAE) into Standard American English (SAE), effectively rewriting the dialect. The study introduces a framework for auditing this bias using conditional Dialect Group Invariance (cDGI) and identifies negative concord as a key trigger. For mitigation, the researchers applied activation steering, a training-free method, which significantly reduced bias while maintaining SAE fluency. The work also includes the release of REAL-AAE, a substantial parallel corpus of AAE and SAE text. AI
IMPACT Highlights a significant bias in LLMs that could impact communication and representation for millions of speakers.
RANK_REASON The cluster contains a research paper detailing findings on LLM bias and a proposed mitigation method.
- activation steering
- African American English
- BERTScore
- conditional Dialect Group Invariance
- large language models
- REAL-AAE
- Standard American English
- arXiv
- Dialect Group Invariance
- Hugging Face
AI-generated summary · Google Gemini · from 2 sources. How we write summaries →