Researchers have developed a novel, training-free method to detect and suppress risky content generated by Diffusion Transformers (DiTs), a type of text-to-image model. The technique identifies concepts within the model's attention heads, which exhibit sensitivity to specific semantic concepts. By quantifying token sensitivity and using a momentum-based strategy, the method adaptively suppresses attention logits associated with risky tokens, effectively mitigating the generation of harmful, sexual, or copyright-infringing images while maintaining visual quality and robustness against adversarial prompts. AI
IMPACT Enhances safety for text-to-image models, potentially reducing the spread of harmful or copyrighted content.
RANK_REASON The cluster contains a research paper detailing a new method for AI safety. [lever_c_demoted from research: ic=1 ai=1.0]
- alphaXiv
- arXiv
- CatalyzeX
- Chenyu Zhang
- Connected Papers
- DagsHub
- Diffusion Transformers
- Gotit.pub
- Hugging Face
- Litmaps
- Scite
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →