A new Python toolkit called resk-llm has been released to help developers protect patient booking chatbots, such as those used by Doctolib, from prompt injection attacks. The toolkit, which can be integrated via FastAPI middleware, offers 11 different detectors to identify and block malicious inputs before they reach the language model. These detectors are designed to prevent various threats, including data exfiltration, service disruption, and memory poisoning, by analyzing messages for direct injections, jailbreaks, semantic similarities to known attacks, framing manipulation, and access violations. The toolkit also supports multi-turn conversation tracking to detect gradual goal hijacking and allows for input sanitization and output validation. AI
IMPACT Enhances the security of AI-powered customer service applications against malicious attacks.
RANK_REASON Release of a new software toolkit for AI security.
- ACLDecisionTreeDetector
- BypassDetector
- ContentFramingDetector
- DirectInjectionDetector
- Doctolib
- FastAPI
- MemoryPoisoningDetector
- resk2
- resk-llm
- VectorSimilarityDetector
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →