PulseAugur
EN
LIVE 23:56:37

Meta releases MobileMoE on-device LLM family

Meta has released MobileMoE, a collection of on-device Mixture-of-Experts language models designed for efficiency on mobile devices. The models feature sub-billion active parameters and come in three scales (S/M/L) with active parameter counts of 0.3B, 0.5B, and 0.9B, respectively. Each scale is available in Base, SFT, and QAT variants, with weights under 3 GB to fit within mobile DRAM. AI

IMPACT Enables more powerful LLM capabilities directly on mobile devices, improving privacy and reducing latency.

RANK_REASON Frontier-lab model release with system card. [lever_c_demoted from frontier_release: ic=1 ai=1.0]

Read on r/LocalLLaMA →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

Meta releases MobileMoE on-device LLM family

COVERAGE [1]

  1. r/LocalLLaMA TIER_1 English(EN) · /u/jacek2023 ·

    MobileMoE - a facebook Collection

    <table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1vxbpcc/mobilemoe_a_facebook_collection/"> <img alt="MobileMoE - a facebook Collection" src="https://external-preview.redd.it/qWAEbcWZrM1iGsZ9WfpE7cv1wsUC5nIBemZJq9ltTVQ.png?width=640&amp;crop=smart&amp;auto=w…