Ollama has released version v0.40.9, introducing several new features and improvements. The update enables speech generation on Apple Silicon using Phonon, allowing users to play text or model replies aloud and stream audio via an OpenAI-compatible endpoint. Additionally, Ollama now supports vLLM Semantic Router's decision models, enabling classification, yes/no answers, and scoring of options based on text, structured state, or images. The release also brings Flint to Linux and Windows, alongside other enhancements like improved streaming request error reporting and better context length handling for coding tools. AI
IMPACT Enhances local LLM usability with new features like speech and decision-making capabilities.
RANK_REASON This is a software release for a tool that runs LLMs locally, not a frontier model release or significant industry event.
- Anthropic
- Apple Silicon
- arXiv
- GitHub
- GitHub Copilot
- GPicSync
- Halcyon
- Halcyon-1.6B
- Hugging Face
- JiT-T2I-XXL/8++
- Keshigeyan Chandrasegaran
- Linux
- LlamaGen-XL/8
- macOS
- Microsoft Windows
- Ollama
- OpenAI
- Phonon
- vLLM Semantic Router
AI-generated summary · Google Gemini · from 4 sources. How we write summaries →