A new research paper published on arXiv highlights significant security vulnerabilities in large language models (LLMs) concerning low-resource languages. The study found that harmful requests refused in English can elicit unsafe responses when translated into these less common languages, with bypass rates ranging from 21.9% to 44.4% across ten widely deployed LLMs. This translation bypass risk is concentrated within specific language families and varies considerably between different models, indicating a critical gap in current safety alignment and evaluation practices. AI
IMPACT Reveals critical safety gaps in LLMs for non-English languages, potentially impacting global deployment and requiring new alignment strategies.
RANK_REASON Research paper detailing a novel threat model and evaluation of LLM safety. [lever_c_demoted from research: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →