Lame

LLM Tokenization Vulnerabilities Explored in Prompt Injection Attacks

Large Language Models (LLMs) often use byte-pair encoding for tokenization, which can lead to them treating visually similar but distinct character sequences as different words. This difference in interpretation can be …