A network of over 400 AI applications, disguised as mundane services like pet portrait generators or language tutors, have been found to contain hidden features for creating sexually abusive deepfake images and videos. These apps, often linked to Chinese developers and a Hong Kong-registered entity, were available on both Apple's App Store and Google Play Store. Researchers discovered these apps by investigating ads on Meta's Facebook and Instagram that promoted explicit deepfake content, including child sexual abuse material. Despite platform policies against harmful content, these apps have evaded detection and enforcement, operating for about a year and generating significant revenue through in-app purchases. AI
IMPACT Highlights significant gaps in AI app moderation and the potential for malicious use of generative AI technologies.
RANK_REASON Investigation into a large network of apps with hidden harmful features that bypassed platform reviews.
Read on Mastodon — mastodon.social →
- AI Forensics
- Apple Inc.
- App Store
- Google Play Store
- KeLing Technology Limited
- Meta
- Paul Bouchaud
- Viefur
AI-generated summary · Google Gemini · from 5 sources. How we write summaries →