Cloudflare reported a security vulnerability in its GLM-5.3 model where a bug in SGLang allowed requests to access leftover memory from previous sessions. This issue, which occurred between August 27 and September 9, affected users sending prompts up to 700k tokens, with the cache holding 681k tokens. Cloudflare has since released an update to address the cache size and context length mismatch. AI
IMPACT Highlights potential security risks in LLM infrastructure and the importance of proper cache management.
RANK_REASON A specific bug in an AI model's infrastructure led to a data exposure incident.
Read on Mastodon — mastodon.social →
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →