CacheProbe: Auditing Prompt Cache Isolation in Gateway APIs
Researchers have developed a method called CacheProbe to audit prompt caching in Large Language Models (LLMs). This technique investigates whether API gateways, like OpenRouter, introduce vulnerabilities that bypass isolation guarantees. The study aims to determine if shared credentials inadvertently lead to global cache sharing across all users, potentially leaking sensitive information. AI
IMPACT This research highlights potential security risks in LLM API implementations, urging developers to ensure robust isolation of prompt caches to prevent data leakage.