Unsloth Studio has released version v0.1.48-beta, introducing significant enhancements for model exporting and API serving. The update allows for exporting models in various formats including NVFP4, FP8, and imatrix GGUFs, and introduces a more robust OpenAI-Compatible API serving with features like automatic model swapping and tool-call healing. Additionally, the release improves RAG and file chat capabilities, offering better document parsing and customizable embedding models, alongside general polish and reliability improvements across the Unsloth platform. AI
IMPACT Enhances local LLM deployment and interoperability with improved export formats and API serving.
RANK_REASON Software release with new features and improvements for an existing tool.
- DeepSeek-V4 Flash
- FP8
- GGUF
- Grpo
- Hugging Face
- imatrix GGUF
- Llama-swap API
- Mlx
- NVFP4
- OpenAI-Compatible API
- safetensors
- Unsloth Studio
- Lora
AI-generated summary · Google Gemini · from 2 sources. How we write summaries →