A new programming language named KillSwitch has been developed with the specific intention of being unusable by large language models. Created by Dominik Picheta, the language incorporates deceptive specifications, anagram-based function calls, and random value selection to challenge LLM capabilities. Initial benchmarks show that even advanced models struggle, scoring below 70% on basic tasks. The language's interpreter, built in Rust, successfully executes sample programs, but its design intentionally exploits LLM weaknesses in precise arithmetic and context management, leading to failures in its own test suite. AI
IMPACT This novel programming language highlights current LLM limitations in handling complex, intentionally misleading specifications and precise symbolic manipulation.
RANK_REASON The item describes a new programming language designed to be unusable by LLMs, including its technical details and initial testing results.
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →
