Gaming AI-Assisted Peer Reviews Poses New Risks to the Scientific Community
Recent research highlights significant vulnerabilities in AI-assisted scientific peer review systems. Studies demonstrate that AI reviewers can be manipulated through presentation-only revisions, such as altering abstracts or framing, without changing the core scientific content. These attacks can lead to inflated scores and increased acceptance rates, raising concerns that authors might optimize for AI judgment over scientific merit. Furthermore, multimodal AI reviewers are susceptible to attacks targeting figures and text, necessitating robust defenses and careful human oversight to maintain the integrity of the peer-review process. AI
IMPACT Highlights the need for robust AI systems in scientific evaluation to prevent manipulation and ensure integrity.