A new arXiv paper investigates the performance of open-weight large language models (LLMs) like Llama, Mistral, Gemma, and Qwen for detecting offensive language in Danish, a low-resource task. The study found that even without specific fine-tuning, these LLMs outperformed fine-tuned BERT-family models. While prompt design and model pre-training interact in complex ways, semantically grounded prompts proved more robust than format-constrained ones. The research also highlighted that Danish-specific characters like 'æ', 'ø', and 'å' carry meaningful signal, and that class imbalance remains a significant challenge for accurate detection. AI
IMPACT Demonstrates the potential of open-weight LLMs for specialized, low-resource NLP tasks, suggesting broader applicability beyond high-resource languages.
RANK_REASON Academic paper detailing model performance on a specific task. [lever_c_demoted from research: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →