PulseAugur
EN
LIVE 02:21:05

Claude user banned for developing parental monitoring tool

A user developing a parental monitoring tool was banned from using Anthropic's Claude, specifically Opus, due to the AI's security filtering. Despite the user's transparency and attempts to comply with usage policies, their account was suspended after forms were rejected and they received only AI-generated responses. The user criticizes the lack of transparency and human oversight in the CVP (Content and Vulnerability Policy) process, suggesting that evasive users might have an easier time bypassing restrictions. AI

IMPACT Highlights potential friction points for developers using AI tools for legitimate, albeit dual-use, applications.

RANK_REASON User expresses opinion and criticism about a product's safety features and support process.

Read on r/Anthropic →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

COVERAGE [1]

  1. r/Anthropic TIER_1 English(EN) · /u/PrettyFlyForITguy ·

    I just got banned from Claude. I think this process of CVP and security filtering needs a lot of work

    <!-- SC_OFF --><div class="md"><p>I work in computer security. I'm a sysadmin, programmer, security lead... I get that we don't want people making nefarious things with AI. I've only been using Claude for a month, and I think its very effective compared to Gemini... but for some …