A new research paper titled "Copies Are Not Confirmations" investigates how large language models (LLMs) are fooled by duplicated news content. The study found that models like Llama 3.2 and Phi4 Ceti incorrectly treat multiple identical news reports as independent confirmations, significantly increasing their acceptance of false information. While Gemini 2.5 Pro and Gemini 2.5 Flash showed varying degrees of susceptibility, the research suggests that simply counting reports or relying on basic provenance information is insufficient to prevent LLMs from being misled by duplicated content. AI
IMPACT Highlights a vulnerability in LLMs that could be exploited to spread misinformation, necessitating improved methods for verifying information provenance.
RANK_REASON Research paper published on arXiv detailing findings about LLM behavior. [lever_c_demoted from research: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →