New Qwen3.8 LLM model available for local deployment on Hugging Face

A new quantized model, soyaakinohara/qwen3.8-27b-abliterated-3.69bpw-12GB-MTP.gguf, is now available on Hugging Face, offering users a way to run a large language model locally. The model is compatible with various inference engines and applications, including llama.cpp, vLLM, Ollama, and Unsloth Studio. Detailed instructions are provided for integrating this model with these tools, enabling local deployment and inference for users. AI

IMPACT Enables users to run advanced LLMs locally, expanding accessibility and reducing reliance on cloud-based services.

RANK_REASON The item describes a specific model's availability and integration instructions with various local inference tools, fitting the 'tool' category.

Read on Hugging Face Trending Models →

• Docker
• GitHub
• Hugging Face
• llama.cpp
• Ollama
• OpenAI
• soyaakinohara/qwen3.8-27b-abliterated-3.69bpw-12GB-MTP.gguf
• Unsloth Studio
• vLLM
• Winget

• model release
• product

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →