Amazon Web Services (AWS) has detailed a process for fine-tuning the GPT-OSS-20B open-weight reasoning model to improve its performance in multiple languages. The base model struggled with multilingual reasoning, often reverting to English. By employing Supervised Fine-Tuning (SFT) and Group Relative Policy Optimization (GRPO) on Amazon SageMaker HyperPod, AWS demonstrated significant improvements in the model's ability to reason and answer in French, German, Spanish, and Italian. The study also included a control experiment with Qwen2.5-7B to further understand the effectiveness of GRPO. AI
IMPACT Demonstrates methods to improve multilingual capabilities of open-weight models, potentially broadening their applicability.
RANK_REASON Blog post detailing a specific fine-tuning methodology for an open-weight model. [lever_c_demoted from research: ic=1 ai=1.0]
Read on AWS Machine Learning Blog →
- Amazon Elastic Kubernetes Service (Amazon EKS)
- Amazon SageMaker HyperPod
- English
- French
- German
- GPT OSS 20B
- Group Relative Policy Optimization (GRPO)
- HuggingFaceH4/Multilingual-Thinking
- Italian
- qwen2.5:7b
- Spanish
- Supervised Fine-Tuning (SFT)
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →