Motif Technologies releases Motif-3-Beta MoE model with 256K context

Motif Technologies has released a beta version of its large-scale Mixture-of-Experts (MoE) language model, Motif-3-Beta. This in-house developed model boasts approximately 314 billion total parameters with 13 billion active per token, and supports a native context length of 256,000 tokens. The model utilizes a sparse routing mechanism with 384 experts, activating 8 per token plus one shared expert. Instructions and code are available for integration with popular libraries like Transformers, and inference engines such as vLLM and SGLang, with support for Docker deployments. AI

IMPACT Sets new SOTA on long-context benchmarks; pressures competitors like Upstage and SKT.

RANK_REASON Frontier-lab model release with system card [lever_c_demoted from frontier_release: ic=2 ai=1.0]

Read on Hugging Face Trending Models →

• A.X Series
• Deepseek V4 Pro
• EXAONE Series
• LG AI Research
• MiniMax-M3
• Motif 3 Beta
• Motif Technologies
• Solar Series
• Upstage
• Docker
• Google Colab
• Kaggle
• lmsysorg
• Motif-Technologies/Motif-3-Beta
• OpenAI
• SGLang
• transformers
• vLLM

• model release
• product

AI-generated summary · Google Gemini · from 2 sources. How we write summaries →