PulseAugur
EN
LIVE 11:34:13

New benchmark reveals disability stereotypes in text-to-image AI models

By PulseAugur Editorial · [3 sources] ·

Researchers have introduced INCLUDE-BENCH, a new benchmark designed to evaluate disability-related biases in text-to-image (T2I) models. The benchmark, which includes 119,000 generated images, reveals that T2I models often depict individuals with disabilities, particularly those with mobility impairments, predominantly in wheelchairs. The study also found that disability-conditioned generations tend to have less diversity and that stereotypical portrayals align more strongly with disability-related text prompts. A new metric, the Stereotype Content Model (SCM) Score, was developed to quantify these real-world stereotypical associations reflected in T2I outputs. AI

IMPACT Highlights the need for more nuanced evaluation of AI models to prevent the perpetuation of harmful stereotypes towards people with disabilities.

RANK_REASON The cluster describes a new academic paper introducing a benchmark for evaluating bias in AI models.

Read on Hugging Face Daily Papers →

AI-generated summary · Google Gemini · from 3 sources. How we write summaries →

New benchmark reveals disability stereotypes in text-to-image AI models

COVERAGE [3]

  1. Hugging Face Daily Papers TIER_1 English(EN) ·

    Beyond wheelchairs and blindfolds: Investigating disability stereotypes in T2I models with INCLUDE-BENCH

    Text-to-image (T2I) models have been shown to exhibit social biases. Prior work has mainly focused on gender, skin tone, and cultural representation within restricted occupational associations, and emerging benchmarks increasingly incorporate these dimensions. However, disability…

  2. arXiv cs.CV TIER_1 English(EN) · Sophia Lichtenberg, Albert Gatt, Judith Masthoff ·

    Beyond wheelchairs and blindfolds: Investigating disability stereotypes in T2I models with INCLUDE-BENCH

    arXiv:2607.08515v1 Announce Type: new Abstract: Text-to-image (T2I) models have been shown to exhibit social biases. Prior work has mainly focused on gender, skin tone, and cultural representation within restricted occupational associations, and emerging benchmarks increasingly i…

  3. arXiv cs.CV TIER_1 English(EN) · Judith Masthoff ·

    Beyond wheelchairs and blindfolds: Investigating disability stereotypes in T2I models with INCLUDE-BENCH

    Text-to-image (T2I) models have been shown to exhibit social biases. Prior work has mainly focused on gender, skin tone, and cultural representation within restricted occupational associations, and emerging benchmarks increasingly incorporate these dimensions. However, disability…

RELATED ENTITIES

RELATED TOPICS