GLM-5.2 runs on custom hardware with 330k context window

A user has successfully configured and is running the GLM-5.2 large language model on a custom hardware setup. The setup utilizes four NVIDIA GB10 Grace Blackwell Superchips, connected by a 100G switch, and supports a context window of 330k tokens. Performance benchmarks indicate approximately 25 tokens/second for typical tasks and up to 650 tokens/second for prefill operations, with potential for further optimization through model pruning. AI

IMPACT Demonstrates feasibility of running large context models on custom, high-performance local hardware.

RANK_REASON User-configured hardware setup for running an LLM.

Read on r/LocalLLaMA →

• 100G Switch
• GLM-5.2
• NVIDIA GB10 Grace Blackwell Superchip

• infra
• model release

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →