PulseAugur
EN
LIVE 12:41:59

New 'CoSnitch' technique exploits AI assistants to reveal architecture details

A security researcher has detailed a new method called CoSnitch, which uses social engineering tactics to trick AI assistants like Copilot and ChatGPT into revealing sensitive information about their internal architecture and security posture. This technique highlights a broader trend where attackers are focusing on 'interviewing' AI models rather than trying to break them directly. The core issue lies not just in the prompt injection method, but in the accessibility of sensitive data within the AI's context window, suggesting a need for stricter data boundaries and treating AI outputs as untrusted input. AI

IMPACT Highlights the ongoing challenge of securing AI assistants and the need for developers to implement stricter data access controls.

RANK_REASON The item discusses a new technique for exploiting existing AI tools, rather than a release of a new frontier model or a significant industry-wide event.

Read on dev.to — LLM tag →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

New 'CoSnitch' technique exploits AI assistants to reveal architecture details

COVERAGE [1]

  1. dev.to — LLM tag TIER_1 English(EN) · Cor E ·

    CoSnitch Is a Reminder That Your Chatbot Will Tell on You If You Ask Nicely Enough

    <p>An AI assistant got talked into describing its own guts to a stranger. That's not a jailbreak curiosity, that's reconnaissance-as-a-service, and it should worry anyone who's bolted an LLM onto production infrastructure without thinking about what the model actually knows.</p> …