Unsloth beta adds 2x faster inference, API calling, and MLX support

Unsloth has released version v0.1.405-beta, introducing significant performance enhancements and new features. The update includes up to 2x faster GGUF inference through MTP speculative decoding and adds API calling support for services like OpenAI and Anthropic, enabling features such as web search and code execution. Additionally, Unsloth now offers experimental MLX inference for Mac users and improved support for non-English languages, alongside various security and UI/UX improvements. AI

IMPACT Accelerates local LLM inference and integration capabilities for developers.

RANK_REASON This is a software release for an AI tooling company, not a core model release from a frontier lab.

Read on Unsloth — Releases →

• Anthropic
• MLX
• Ollama
• OpenAI
• Qwen3.6
• Unsloth
• vLLM

• model release
• product
• infra

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →