A report by the nonprofit AI Forensics has revealed that the open-source AI platform Hugging Face hosts a significant number of models capable of generating nonconsensual deepfake nudes. Researchers found that seven out of nine tested image editing Spaces on the platform could easily transform clothed images into topless ones. Further testing indicated that a large majority of prompts submitted to these Spaces were sexual in nature, with a substantial portion seeking to sexualize or undress individuals, predominantly women and sometimes children. Despite having content policies against such material, Hugging Face appears to lack robust platform-level safeguards, allowing users to generate these harmful images. AI
IMPACT Highlights a critical failure in AI platform safety, potentially accelerating regulatory action against open-source model distribution.
RANK_REASON Report details significant safety and policy failures at a major AI platform.
Read on Mastodon — fosstodon.org →
AI-generated summary · Google Gemini · from 2 sources. How we write summaries →
