New research from Cornell University indicates that AI search engines and tools like ChatGPT can be easily manipulated by small snippets of user-generated content. A mere 13 words from platforms such as Reddit, Quora, or Wikipedia can be sufficient to inject promotional or misleading information into AI outputs. This phenomenon, termed AI-engine optimization (AEO), poses a significant challenge for content moderators and raises concerns about the integrity of information accessed online. AI
IMPACT Highlights a critical vulnerability in AI information retrieval, potentially impacting trust and accuracy across AI-powered search and content generation tools.
RANK_REASON The cluster reports on a preprint research paper detailing a new vulnerability in AI systems.
- 404 Media
- ChatGPT
- Cornell University
- Hal Triedman
- Quora
- Tingwei Zhang
- Vitaly Shmatikov
- Wikipedia
AI-generated summary · Google Gemini · from 5 sources. How we write summaries →