PulseAugur
EN
LIVE 13:19:05

OpenAI and Google AI image models easily tricked into creating explicit content

Researchers have discovered that leading AI image generation models from OpenAI and Google are susceptible to bypasses that allow for the creation of explicit content. A study by White Circle found that simple, readily available tools could circumvent safety filters approximately 13% of the time when interacting with models like DALL·E 3 and Google's Nano Banana 2. This vulnerability raises concerns about the unchecked spread of non-consensual explicit AI-generated imagery, with researchers emphasizing the need for stronger safeguards at the source of these AI tools. AI

IMPACT Highlights ongoing challenges in AI safety and content moderation, potentially impacting user trust and regulatory scrutiny for image generation models.

RANK_REASON Researchers found vulnerabilities in existing AI image generation tools, rather than a new model release.

Read on r/OpenAI →

AI-generated summary · Google Gemini · from 2 sources. How we write summaries →

OpenAI and Google AI image models easily tricked into creating explicit content

How we ranked this

Signal score
1 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Tool
Researchers found vulnerabilities in existing AI image generation tools, rather than a new model release.
Source corroboration
2 independent sources
Multiple independent publishers reporting the same story raises confidence that it's real and newsworthy.
Topics
safety, product
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
1 days old
Coverage has settled into its steady-state source set.

Full methodology in our editorial standards.

COVERAGE [2]

  1. Ars Technica — AI TIER_1 English(EN) · Ashley Belanger ·

    OpenAI, Google pushing new AI models easily tricked into making nudes, researchers say

    Attack method exposes flaws in OpenAI, Google safeguards against AI nudes.

  2. r/OpenAI TIER_2 English(EN) · /u/rhiever ·

    Researchers say new OpenAI and Google image models are easily tricked into making nudes

    <table> <tr><td> <a href="https://www.reddit.com/r/OpenAI/comments/1x5uito/researchers_say_new_openai_and_google_image/"> <img alt="Researchers say new OpenAI and Google image models are easily tricked into making nudes" src="https://external-preview.redd.it/hcJpK02mek6VkODSihKMv…