Meta has released MobileMoE, a collection of on-device Mixture-of-Experts language models designed for efficiency on mobile devices. The models feature sub-billion active parameters and come in three scales (S/M/L) with active parameter counts of 0.3B, 0.5B, and 0.9B, respectively. Each scale is available in Base, SFT, and QAT variants, with weights under 3 GB to fit within mobile DRAM. AI
IMPACT Enables more powerful LLM capabilities directly on mobile devices, improving privacy and reducing latency.
RANK_REASON Frontier-lab model release with system card. [lever_c_demoted from frontier_release: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →