PulseAugur
实时 05:57:18

Study finds Shapley value benchmarks for AI explainability misaligned with human utility

A new paper examines the evaluation of explainable AI (XAI) methods, specifically Shapley value variants, in high-stakes scenarios like fraud detection. Researchers found that standard quantitative metrics for XAI do not align with human understanding or decision utility. While the tested XAI formulations did not improve analyst performance, they did increase decision confidence, raising concerns about automation bias. AI

影响 Current XAI evaluation metrics may not reflect real-world human utility, potentially leading to overconfidence and automation bias in critical decision-making.

排序理由 Academic paper on XAI evaluation methods.

在 arXiv cs.AI 阅读 →

AI 生成摘要 · Google Gemini · 来自 2 个来源。 我们如何撰写摘要 →

Study finds Shapley value benchmarks for AI explainability misaligned with human utility

报道来源 [2]

  1. arXiv cs.LG TIER_1 English(EN) · In\^es Oliveira e Silva, S\'ergio Jesus, Iker Perez, Rita P. Ribeiro, Carlos Soares, Hugo Ferreira, Pedro Bizarro ·

    Rethinking XAI Evaluation: A Human-Centered Audit of Shapley Benchmarks in High-Stakes Settings

    arXiv:2604.22662v1 Announce Type: new Abstract: Shapley values are a cornerstone of explainable AI, yet their proliferation into competing formulations has created a fragmented landscape with little consensus on practical deployment. While theoretical differences are well-documen…

  2. arXiv cs.AI TIER_1 English(EN) · Pedro Bizarro ·

    Rethinking XAI Evaluation: A Human-Centered Audit of Shapley Benchmarks in High-Stakes Settings

    Shapley values are a cornerstone of explainable AI, yet their proliferation into competing formulations has created a fragmented landscape with little consensus on practical deployment. While theoretical differences are well-documented, evaluation remains reliant on quantitative …