Meta AI Research has released Muse Spark Open, an 816B-parameter mixture-of-experts model designed for coding and agentic tasks. This open-weight model supports multimodal inputs including text, image, audio, and video, and boasts a 1 million token context window. Developers have noted that the model's reasoning capabilities are always active and consume tokens from the same budget as the output, requiring careful management of the `max_tokens` parameter. Additionally, the KV cache size is significantly smaller than what might be expected for a model of its parameter count, due to a hybrid attention mechanism that limits the full context to a subset of layers. AI
IMPACT This release provides a powerful open-weight multimodal model for coding and agentic tasks, potentially accelerating development in these areas.
RANK_REASON Frontier-lab model release with system card. [lever_c_demoted from frontier_release: ic=1 ai=1.0]
- Baseten
- Fireworks AI
- Groq
- Hugging Face
- Marylise Tauzia
- Meta
- Meta AI Research
- Modal
- Muse Spark Open
- Nebius Group
- OpenRouter
- Pedro Cuenca
- Together AI
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →