PulseAugur
EN
LIVE 10:03:59

Hundreds of AI apps with hidden deepfake features evade app store reviews

A network of over 400 AI applications, disguised as mundane services like pet portrait generators or language tutors, have been found to contain hidden features for creating sexually abusive deepfake images and videos. These apps, often linked to Chinese developers and a Hong Kong-registered entity, were available on both Apple's App Store and Google Play Store. Researchers discovered these apps by investigating ads on Meta's Facebook and Instagram that promoted explicit deepfake content, including child sexual abuse material. Despite platform policies against harmful content, these apps have evaded detection and enforcement, operating for about a year and generating significant revenue through in-app purchases. AI

IMPACT Highlights significant gaps in AI app moderation and the potential for malicious use of generative AI technologies.

RANK_REASON Investigation into a large network of apps with hidden harmful features that bypassed platform reviews.

Read on Mastodon — mastodon.social →

AI-generated summary · Google Gemini · from 5 sources. How we write summaries →

Hundreds of AI apps with hidden deepfake features evade app store reviews

How we ranked this

Signal score
3 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Significant
Investigation into a large network of apps with hidden harmful features that bypassed platform reviews.
Source corroboration
5 independent sources
Strong cross-source corroboration — multiple independent publishers covered this within the clustering window.
Topics
product, policy, safety
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
1 days old
Coverage has settled into its steady-state source set.

Full methodology in our editorial standards.

COVERAGE [5]

  1. Wired — AI TIER_1 English(EN) · Matt Burgess ·

    Hundreds of Mundane AI Apps Are Hiding Sexually Abusive Deepfake Features

    WIRED uncovered some 400 apps and websites linked to Chinese-language developers that look like regular AI tools but had secret features that let users create violent AI-generated images and video.

  2. Mastodon — mastodon.social TIER_1 English(EN) · [email protected] ·

    AI apps with hidden sexual and violent deepfake features made it into the App Store Hundreds of AI apps with hidden sexual and violent deepfake features made it

    AI apps with hidden sexual and violent deepfake features made it into the App Store Hundreds of AI apps with hidden sexual and violent deepfake features made it into Apple’s App Store after passing app review. The same apps were also available in the Google Play Store. An investi…

  3. Mastodon — mastodon.social TIER_1 English(EN) · [email protected] ·

    More Evidence Emerges That Dating Is Becoming a Bleak, AI-Powered Office Job Two "Claudes were probably just chatting away behind the scenes,” one man told the

    More Evidence Emerges That Dating Is Becoming a Bleak, AI-Powered Office Job Two "Claudes were probably just chatting away behind the scenes,” one man told the Guardian. https:// gizmodo.com/more-evidence-emer ges-that-dating-is-becoming-a-bleak-ai-powered-office-job-2000833565 #…

  4. Mastodon — mastodon.social TIER_1 English(EN) · [email protected] ·

    Hundreds of Mundane AI Apps Are Hiding Sexually Abusive Deepfake Features WIRED uncovered some 400 apps and websites linked to Chinese-language developers that

    Hundreds of Mundane AI Apps Are Hiding Sexually Abusive Deepfake Features WIRED uncovered some 400 apps and websites linked to Chinese-language developers that look like regular AI tools but had secret features that let users create violent AI-generated images and video. https://…

  5. Mastodon — mastodon.social TIER_1 Français(FR) · [email protected] ·

    Hundreds of seemingly innocuous AI apps hide non-consensual sexual deepfake features. This isn't a design flaw—it's a feature

    Des centaines d'apps IA d'apparence banale dissimulent des fonctionnalités de deepfakes sexuels non consentis. Ce n'est pas un bug de conception — c'est une surface d'attaque délibérément camouflée derrière des interfaces anodines. La question n'est pas seulement technique : c'es…