Unsloth has released optimized versions of two large language models, GLM-5.3-Flash and Qwen3.8-Flash-Next, in GGUF format. These models are designed for efficient local deployment and are compatible with various inference engines and tools like Hugging Face Transformers, vLLM, llama.cpp, and Ollama. The GLM-5.3-Flash model is highlighted as a multimodal model with a hybrid architecture, aiming to balance performance and cost, while the Qwen3.8-Flash-Next model is available in both standard and uncensored versions. AI
IMPACT Facilitates wider adoption and easier local deployment of advanced LLMs.
RANK_REASON Release of optimized model formats (GGUF) for local deployment, with instructions for various inference tools.
Read on Hugging Face Trending Models →
- Claude Opus 4.8
- Docker
- GLM-5.2
- Google Colab
- Hugging Face
- Kaggle
- llama.cpp
- Ollama
- OpenAI
- unsloth/GLM-5.3-Flash-GGUF
- unsloth/Qwen3.8-Flash-Next-GGUF
- vLLM
- Z.ai API Platform
- orcarouter/Qwen3.8-Flash-Next-Uncensored-GGUF
- Qwen3.8-Flash-Next
- transformers
AI-generated summary · Google Gemini · from 5 sources. How we write summaries →