New benchmark results for the GLM-5.3 and Qwen 3.8 27B models on the SlopCodeBench have been released. GLM-5.3 achieved a score of 8/17 on a 17-checkpoint subset and 10/30 on a 30-checkpoint subset, tying with Fable 5 and GPT-5.6 Sol on the latter. Qwen 3.8 27B performed less impressively, scoring 3/17 on the 17-checkpoint subset and 4/30 on the 30-checkpoint subset, indicating potential issues with code management and organization when used autonomously. AI
IMPACT These benchmarks provide insights into the coding capabilities of different LLMs, informing developers and researchers about their strengths and weaknesses in handling complex coding tasks.
RANK_REASON The cluster reports benchmark results for AI models on a specific coding task, which falls under AI research.
- Claude Code
- DeepSeek V4 Flash
- GPT-5.6 Sol
- HumanLayer Fable, Sol, and Kimi Benchmark Subset
- HumanLayer Opus 5 Benchmark Subset
- Kimi K3
- Qwen
- SlopCodeBench
- GLM-5.3
- Qwen 3.8 27B
- Qwen3.8-27B
AI-generated summary · Google Gemini · from 2 sources. How we write summaries →