PulseAugur
EN
LIVE 06:02:12

AI-generated phantom references infiltrate top-tier scientific conferences

A new study published on arXiv has revealed that large language models are contributing to the problem of "phantom references" or hallucinated citations in scientific papers. These fabricated citations, which do not resolve to real scholarly works, are appearing in peer-reviewed proceedings from top-tier conferences like ICLR, ICML, NeurIPS, and USENIX Security. The research indicates that while overall rates are low, the sheer volume of papers means a significant number contain these errors, with some papers exhibiting multiple hallucinations. The study also noted an increase in such errors following the release of ChatGPT, even appearing in award-winning papers, suggesting that current peer review processes are insufficient to catch these AI-generated inaccuracies. AI

IMPACT Highlights a critical flaw in AI-generated scientific text, potentially undermining research integrity and necessitating new verification methods.

RANK_REASON Research paper detailing a novel finding about AI-generated content in academic publications. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.AI →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

AI-generated phantom references infiltrate top-tier scientific conferences

COVERAGE [1]

  1. arXiv cs.AI TIER_1 English(EN) · Ahmed Salem ·

    Phantom References: Hallucinated Citations That Survive Peer Review at Top-Tier Conferences

    Large language models can generate polished scientific text that includes unsupported claims, allowing hallucinations to enter the archival record. Assessing this risk via technical statements is difficult and often requires expert judgment, but citations provide a more auditable…