4-bit GLM-5.2 quantized model achieves 70.8% on Terminal-Bench 2.1

A user successfully ran a 4-bit quantized version of the GLM-5.2 (753B MoE) model on a DGX Spark setup with 100K context. The quantized model achieved 70.8% on the Terminal-Bench 2.1 benchmark, which is approximately 87% of the performance of the full-precision model. The experiment required significant computational resources and encountered several technical challenges during its 72.5-hour runtime. AI

IMPACT Demonstrates the viability of running large quantized models on consumer-grade hardware for complex benchmarks.

RANK_REASON User-conducted benchmark of a quantized model. [lever_c_demoted from research: ic=1 ai=1.0]

Read on r/LocalLLaMA →

• DGX Spark
• GLM-5.2
• Terminal-Bench 2.1

• model release
• infra

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →