PulseAugur
EN
LIVE 00:27:38

GLM 5.2 achieves 79.8% on Terminal-Bench 2.1 with FP8 precision

A user on Reddit shared benchmark results for the GLM 5.2 model, achieving a score of 79.8% on the Terminal-Bench 2.1 test. The user specified that this score was achieved using FP8 precision for both the model weights and the key-value cache, with a setup utilizing sglang on H200 hardware. The benchmark included 89 tasks, with 71 passing and 17 failing, and one task timing out. AI

IMPACT Provides specific performance data for the GLM 5.2 model on a benchmark, useful for researchers and developers evaluating model capabilities.

RANK_REASON User-submitted benchmark results for a specific model version and configuration. [lever_c_demoted from research: ic=1 ai=1.0]

Read on r/LocalLLaMA →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

GLM 5.2 achieves 79.8% on Terminal-Bench 2.1 with FP8 precision

COVERAGE [1]

  1. r/LocalLLaMA TIER_1 English(EN) · /u/Daemonix00 ·

    GLM 5.2 FP8 with FP8 KV - Terminal-Bench 2.1 = 79.8 (with one time-out that I didnt re-run)

    <!-- SC_OFF --><div class="md"><p>I wanted to test the official results vs fp8 + fp8 kv. basic sglang setup on H200.</p> <p>If anyone wants one of the official tests do ping me. </p> <p>I didnt rerun the one so it might go up a bit :)</p> <pre><code> TERMINAL-BENCH 2.1 — FINAL RE…