Researchers have developed new datasets and evaluation methods to assess and mitigate anti-LGBTQ+ biases in language models, focusing on Dutch and German contexts. These efforts address the understudied nature of such biases beyond English, creating culturally adapted benchmarks that incorporate community-sourced stereotypes. While initial evaluations show some models exhibit significant bias, particularly against transgender and non-binary identities, fine-tuning on diverse content can reduce these issues, though not always consistently across all models and identities. AI
IMPACT Highlights the need for culturally specific datasets to ensure fairness and reduce harm in AI systems for diverse linguistic communities.
RANK_REASON The cluster consists of two academic papers published on arXiv detailing the creation of new datasets and methodologies for evaluating and mitigating biases in language models.
- arXiv
- Hugging Face
- LGBTQ
- WinoQueer
- ARLMs
- Dutch
- German
- MLMs
- non-binary person
- transgender
- WinoQueer-NL
AI-generated summary · Google Gemini · from 2 sources. How we write summaries →