A project exploring open-source large language models for Kinyarwanda text generation compared GPT-2 and a custom-built tiny GPT model. The custom model produced more Kinyarwanda-like text, but GPT-2 generated more fluent English. The project then evaluated several open-weight models, including Qwen3-4B-Instruct-2507 and Qwen3-1.7B from Alibaba Group, and Llama 3.2-3B-Instruct from Meta, to find a more suitable model for instruction following and Kinyarwanda text generation. AI
IMPACT This research could lead to better language models for under-represented languages, improving accessibility and utility.
RANK_REASON The item discusses research into improving text generation for a specific language using open-source models. [lever_c_demoted from research: ic=1 ai=1.0]
- Alibaba Group
- Apache Software License 2.0
- GPT-2
- KINNEWS
- Kinyarwanda
- Llama 3.2 Community Licence
- Meta*
- Qwen3-1.7B
- Qwen3-4B-Instruct-2507
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →