Underdog, a research initiative from Conway Research, has released Saluki 27B, a highly compressed 2-bit version of the Qwen3.8-27B model. This new model, available under the Apache 2.0 license, significantly reduces the file size from 54 GB to 7.89 GB, allowing it to run on standard llama.cpp implementations. While Saluki 27B shows improved performance in tool calling, achieving 120% retention compared to the original model, it experiences a notable decrease in performance for complex reasoning and math tasks. AI
IMPACT Enables more capable on-device agents by significantly reducing model size while maintaining key functionalities like tool calling.
RANK_REASON Release of a quantized model with performance comparisons. [lever_c_demoted from research: ic=1 ai=1.0]
- Apache Software License 2.0
- BFCL v4
- Conway Research
- ISTA-DASLab
- llama.cpp
- PrismML
- Qwen3.8-27B
- Saluki 27B
- Underdog
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →