Meta has released Muse Spark Open, an 816 billion parameter model with a 1 million token context window, available under a custom license. Initial benchmarks on Apple's Mac Studio M5 Ultra machines reveal that the model requires at least two machines due to its size, exceeding the 512 GB memory capacity of a single unit. The analysis also indicates that the model's cache is relatively small for its context window, and its performance reaches only 42-25% of the theoretical bandwidth ceiling, suggesting potential bottlenecks. AI
IMPACT This analysis highlights potential hardware bottlenecks and performance ceilings for very large models, informing infrastructure and deployment strategies.
RANK_REASON The item details the release of a new large language model and provides a technical analysis of its performance and hardware requirements, fitting the research category. [lever_c_demoted from research: ic=1 ai=1.0]
- Apple Inc.
- Hugging Face
- llama.cpp
- Mac Studio M5 Ultra
- Meta
- Mlx
- Muse Spark Open
- NVFP4
- remote direct memory access
- SGLang
- TensorRT-LLM
- Thunderbolt
- transformers
- Unsloth
- vLLM
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →