English(EN) Reliability, Faithfulness, and the Limits of Post-hoc Explanations of Opaque Scientific Models

arXiv新论文质疑AI模型解释的可靠性

作者 PulseAugur 编辑部 · [2 个来源] · 2026-06-30 04:00

一篇新发表在arXiv上的论文对用于科学机器学习模型的事后解释方法的可靠性提出了质疑。作者认为，虽然这些方法可以检查模型的预测是否与观察到的结果一致，以及解释是否准确反映了模型，但它们并不能验证模型本身是否准确地代表了潜在的科学现象。这一区别对于得出关于现象结构的有效结论至关重要。 AI

影响凸显了理解科学领域AI模型的一个关键差距，可能影响AI驱动的科学发现的可靠性。

排序理由在arXiv上发表的研究论文，讨论了AI模型解释的局限性。[lever_c_demoted from research: ic=1 ai=1.0]

AI 生成摘要 · Google Gemini · 来自 2 个来源。我们如何撰写摘要 →

报道来源 [2]

arXiv cs.AI TIER_1 English(EN) · Martina Mattioli, Marcello Pelillo · 2026-07-01 04:00

Scientific Explanations in Health Sciences: Causality, Trust, and Epistemic Adequacy

arXiv:2606.31616v1 Announce Type: new Abstract: Medical Artificial Intelligence (AI) is widely expected to transform clinical practice, yet the decision-making processes of many Machine Learning (ML) models remain opaque. Explainability has been advanced as a partial remedy to cl…
arXiv cs.LG TIER_1 English(EN) · Nick Oh, Helen Jin · 2026-06-30 04:00

不透明科学模型的事后解释的可靠性、忠实性及其局限性

arXiv:2606.29346v1 Announce Type: new Abstract: Post-hoc explanation methods are routinely used to interpret scientific machine learning models, with the deliverable understood to be insight into the phenomenon the model has been trained on. The transition may be taken to be secu…