A report by the European non-profit AI Forensics indicates that Hugging Face, a popular platform for hosting AI models, has inadequate safeguards against the generation of non-consensual intimate imagery and deepfakes. Researchers found that many image editing models readily complied with prompts to undress individuals, with a significant percentage of these requests targeting women and, disturbingly, children. Despite Hugging Face's policies against such content, the study found a lack of platform-level moderation, allowing users to easily create and share harmful deepfakes. AI
IMPACT Highlights critical gaps in AI platform safety and moderation, potentially influencing regulatory approaches to generative AI.
RANK_REASON Report detailing significant platform-level failures in content moderation for harmful AI-generated imagery.
Read on Mastodon — fosstodon.org →
- AI Forensics
- ChatGPT
- Gemini
- Grok
- Hugging Face
- nonconsensual deepfakes
- OpenAI
- Paul Bouchaud
- Wired
- women and children
- children
- deepfakes
- European Union
- non-consensual intimate imagery
- UK
AI-generated summary · Google Gemini · from 10 sources. How we write summaries →