PulseAugur
EN
LIVE 07:48:15

Deepfake speech datasets lack fairness, overlap in sources

By PulseAugur Editorial · [2 sources] ·

A new audit of 39 deepfake speech datasets reveals significant limitations in their fairness and technical robustness. Researchers found that most datasets lack crucial demographic metadata, making fairness assessments nearly impossible and preventing subgroup analysis. Additionally, a substantial overlap in the source corpora used for bona fide speech across these datasets could lead to overstated generalization claims and undermine cross-dataset evaluations. AI

IMPACT Highlights critical data limitations that could hinder the development and evaluation of fair and robust deepfake speech detection systems.

RANK_REASON The cluster contains an academic paper detailing a dataset audit. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.AI →

AI-generated summary · Google Gemini · from 2 sources. How we write summaries →

COVERAGE [2]

  1. arXiv cs.AI TIER_1 English(EN) · Vojt\v{e}ch Stan\v{e}k, Eva Trnovsk\'a, Kamil Malinka, Anton Firc ·

    Ethical and Technical Limits of Deepfake Speech Datasets

    arXiv:2606.10911v1 Announce Type: cross Abstract: Claims about the robustness and fairness of deepfake speech detectors are only as credible as the datasets used to train and evaluate those systems. We present a dataset-level audit of the deepfake speech landscape. We compile and…

  2. arXiv cs.AI TIER_1 English(EN) · Anton Firc ·

    Ethical and Technical Limits of Deepfake Speech Datasets

    Claims about the robustness and fairness of deepfake speech detectors are only as credible as the datasets used to train and evaluate those systems. We present a dataset-level audit of the deepfake speech landscape. We compile and analyze 39 deepfake speech datasets, examining ke…

RELATED ENTITIES

RELATED TOPICS