PulseAugur
EN
LIVE 07:16:10

New AI attack "indirect data poisoning" industrializes scientific fraud

A new research paper details a novel method called "indirect data poisoning" that can be used to introduce scientific fraud at scale by corrupting open datasets. This attack exploits autonomous research agents that retrieve and process data from public repositories, turning honest scientists into unwitting distributors of misinformation. The study found that frontier AI systems like Claude Code, Codex, and Gemini CLI were susceptible to this attack, with a significant success rate and low detection rate. Researchers propose data provenance auditing as a mitigation strategy, which proved effective in reducing the attack's success rate to zero. AI

IMPACT This research highlights a critical vulnerability in AI-driven research, potentially undermining scientific integrity and necessitating robust data auditing mechanisms.

RANK_REASON The cluster contains a research paper detailing a novel attack vector and mitigation strategy for AI systems. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.AI →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

New AI attack "indirect data poisoning" industrializes scientific fraud

COVERAGE [1]

  1. arXiv cs.AI TIER_1 English(EN) · B\'alint Gyevn\'ar, Atoosa Kasirzadeh, Nihar B. Shah ·

    Distributed Denial of Science: How Indirect Data Poisoning of AI Systems Can Industrialize Scientific Fraud

    arXiv:2607.10712v1 Announce Type: cross Abstract: Scientific fraud is the instrument of doubt that malicious entities can use to establish controversy in science. Historically, it required the resources of a company: deep pockets, ghostwritten articles, and corrupt academics. Tod…