Cloudflare experienced a security incident where a tenant isolation flaw in its GLM-5.3 model, hosted on Workers AI, allowed prompts longer than 681,280 tokens to return data from other customers' sessions. The issue stemmed from a configuration mismatch in the KV cache sizing within the SGLang inference engine, which was not properly handling prompts exceeding the allocated memory. Cloudflare identified and fixed the root cause within hours of the incident being declared, and a public postmortem was released six weeks later after upstream fixes were deployed. AI
IMPACT Highlights the critical need for robust tenant isolation in hosted LLM inference to prevent data leakage.
RANK_REASON The article details a specific security vulnerability and its resolution within a hosted AI model service, which falls under the category of tooling and infrastructure.
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →