New USAF method allows MoE model fine-tuning on consumer GPUs

A new open-source fine-tuning method called USAF has been developed, aiming to enable fine-tuning of Mixture-of-Experts (MoE) models on consumer-grade GPUs. The method focuses on training sparse expert weights and the router, making it possible to fine-tune models like Qwen3-30B-A3B on hardware with as little as 12GB of VRAM. The project is released under the Apache 2.0 license with no commercial intent, encouraging community feedback. AI

IMPACT Lowers the barrier for fine-tuning large MoE models, potentially enabling wider experimentation and customization on consumer hardware.

RANK_REASON Release of an open-source fine-tuning method for MoE models. [lever_c_demoted from research: ic=1 ai=1.0]

Read on r/MachineLearning →

• AMD RX 6750 XT
• graphics processing unit
• Mixture-of-Experts
• Qwen3-30B-A3B

• infra
• model release

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →