New Open-Source Arabic LLM 'RightNow-Arabic-0.5B-Turbo' Released

Researchers have developed RightNow-Arabic-0.5B-Turbo, a new open-source Arabic language model with 518 million parameters. This model is built upon Qwen2.5-0.5B and incorporates a specialized Arabic vocabulary through vocabulary injection. The development process involved extensive pre-training, supervised fine-tuning, and direct preference optimization, culminating in a weight soup merge across multiple checkpoints. The resulting model demonstrates competitive performance on Arabic benchmarks, outperforming other open models in its size class and achieving a significant portion of the performance of much larger models with a fraction of the parameters. It is designed for edge deployment, quantizing to a small file size and delivering fast inference speeds on consumer hardware. AI

IMPACT Provides a smaller, specialized Arabic LLM for edge deployment, potentially increasing accessibility and use cases for Arabic NLP.

RANK_REASON Publication of a research paper detailing a new open-source language model. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.CL →

• AceGPT
• ALLaM
• Arabic
• Falcon-H1-0.5B
• Falcon-H1-1.5B
• Jais
• Kuwain-1.5B
• Qwen2.5-0.5B
• RightNow-Arabic-0.5B-Turbo

• model release
• paper

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →