Ollama has released new versions, v0.32.10 and v0.32.9, introducing performance enhancements and support for new open-weight models. Version v0.32.10 improves speculative decoding by defaulting the repeat_penalty to 1.0, aligning with other inference engines and speeding up local model execution. Both versions add support for NVIDIA's Nemotron 3.5 Lightning, a 30B mixture-of-experts model designed for AI agents, and Meta's Muse Glimmer multimodal model, with v0.32.7 specifically optimizing Muse Glimmer for Apple Silicon via the MLX engine. Additionally, the Muse Glimmer model is now available in GGUF format, making it more accessible for consumer GPUs. AI
IMPACT Enhances local AI development and experimentation by making powerful open-weight models more accessible and performant on consumer hardware.
RANK_REASON Updates to Ollama, a tool for running LLMs locally, including support for new models and performance improvements.
- AMD
- Jetpack
- Kimi K3
- Meta
- Muse Glimmer
- Nemotron 3.5 Lightning
- NVIDIA
- Ollama
- vLLM
- Apple Silicon
- GGUF
- GPU Operator v1.5.0
- Kubernetes
- Nemotron 3.5
AI-generated summary · Google Gemini · from 2 sources. How we write summaries →