A critical bug in Cloudflare Workers AI, affecting the GLM-5.3 model, led to the leakage of 155 customer responses between August 27 and September 9. The issue stemmed from the inference engine serving stale KV cache pages from previous requests, rather than rejecting oversized prompts. This occurred because the KV pool size was smaller than the model's context window, causing an uninitialized read of data from other customers' prompts and generations. Cloudflare has since detailed the incident and implemented fixes, including KV checksums and per-page ownership tags, to prevent recurrence. AI
IMPACT Highlights a critical data leakage vulnerability in AI inference engines, emphasizing the need for robust KV cache management and security audits.
RANK_REASON The article details a specific bug and its resolution within an AI platform, including a diagnostic script, rather than a new model release or significant industry shift.
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →