Unsloth launches API endpoint for local LLM deployment

Unsloth has released a new API inference endpoint that allows users to run local large language models with enhanced features. This endpoint supports both Anthropic-compatible and OpenAI-compatible dialects, enabling seamless integration with various AI agents and chat clients. The update also introduces new models like NVIDIA Nemotron 3 Nano Omni and Mistral 3.5 Medium, alongside several bug fixes and improvements to the Unsloth Studio. AI

IMPACT Enables easier local deployment and integration of various LLMs with enhanced features like self-healing tool calling and code execution.

RANK_REASON This is a product update for a tool that facilitates running local LLMs, rather than a core model release from a frontier lab.

Read on Unsloth — Releases →

• Anthropic
• Claude Code
• Codex
• Gemma
• IBM Granite 4.1
• Mistral 3.5 Medium
• NVIDIA Nemotron 3 Nano Omni
• OpenAI
• Qwen
• Unsloth

• product
• model release

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →