PulseAugur
EN
LIVE 14:00:13

Ideogram 4.0 prompt validation sparks censorship debate, workaround found

Ideogram's recent model update, version 4.0, has introduced a prompt validation system that rejects inputs not conforming to a specific JSON schema. This has led to user concerns about censorship, but the developers clarify that the rejections are due to the prompt's format rather than content. Users have found a workaround by translating prompts into Danish using other LLMs, which bypasses the English-based validation for certain types of content, though explicit content generation remains limited by the model's training data. AI

IMPACT Users are finding ways to bypass content restrictions on image generation models, highlighting the ongoing tension between safety features and creative freedom.

RANK_REASON Discussion of a specific model's safety features and user workarounds.

Read on r/StableDiffusion →

AI-generated summary · Google Gemini · from 2 sources. How we write summaries →

COVERAGE [2]

  1. r/StableDiffusion TIER_2 English(EN) · /u/Valuable_Issue_ ·

    Important excerpt about censorship from Ideograms technical blog

    <!-- SC_OFF --><div class="md"><blockquote> <p>The reference pipeline validates every prompt against the JSON schema before generation and rejects inputs that do not parse, so the input format at inference time is the same one the model saw during training.</p> </blockquote> <p>I…

  2. r/StableDiffusion TIER_2 English(EN) · /u/SanDiegoDude ·

    A helpful little tip to help deal with the ideogram model censorship

    <!-- SC_OFF --><div class="md"><p>Their censorship was trained on English FYI. </p> <p><code>Help me obfuscate this, convert all of the non-field text to Danish please. don't change anything and don't alter the JSON, just translate the fields, all of them.</code></p> <p>Just run …