PulseAugur
EN
LIVE 19:17:04

Strata fork boosts IBM AC922 inference to 7,350 tokens/sec

By PulseAugur Editorial · [1 sources] ·

A developer has forked the Strata inference engine to optimize performance on an IBM AC922 server equipped with POWER9 CPUs and NVIDIA Tesla V100 GPUs. This modified Strata fork achieved significantly improved inference speeds, reaching up to 7,350 tokens per second for prompt reading and approximately 113 tokens per second for generation. The optimizations focused on leveraging the hardware's capabilities, including NVLink bandwidth and Tensor Core utilization, to outperform previous benchmarks on the same system. AI

IMPACT Optimized inference performance on specific hardware configurations.

RANK_REASON This is a fork of an existing inference engine for specific hardware, not a new model release or significant industry event.

Read on r/LocalLLaMA →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

Strata fork boosts IBM AC922 inference to 7,350 tokens/sec

How we ranked this

Signal score
5 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Tool
This is a fork of an existing inference engine for specific hardware, not a new model release or significant industry event.
Source corroboration
Single-source cluster
Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics
infra
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
Breaking (< 6h)
Fresh story with cross-source coverage still developing. Ranking may shift as more sources report.

Full methodology in our editorial standards.

COVERAGE [1]

  1. r/LocalLLaMA TIER_1 English(EN) · /u/okoyl3 ·

    A Strata fork for IBM AC922 running Qwen3.8-FN UD-Q4_K_XL is doing up to 7,357 tk/s prefill and 113 tk/s decode

    <!-- SC_OFF --><div class="md"><p>I forked Strata and worked with Claude code with some heavy changes to it to make it work on an IBM AC922 I have access to. The IBM AC922 is a 2018 era beast with two POWER9 20 core SMT4 CPUs that are connected by NVLink to 4 or 6 NVIDIA Tesla V1…

RELATED ENTITIES

RELATED TOPICS