PulseAugur
EN
LIVE 11:26:29

DeepSeek V4.1 Flash benchmarked at 42 tok/s with 256K context on consumer GPUs

A user has detailed their benchmark results for running the DeepSeek V4.1 Flash model locally on a personal Linux machine. The setup achieved a generation speed of 42 tokens per second with a 256K context window and vision input enabled, utilizing three GPUs. The user emphasizes that these results are from a custom-quantized build and a patched engine, making them not directly comparable to stock configurations of tools like llama.cpp or Ollama. The performance is attributed to a strategic placement of model components across GPUs, system RAM, and an Optane SSD to manage the MoE architecture and large context window. AI

IMPACT Demonstrates high performance for large context models on consumer hardware, potentially lowering barriers for local AI deployment.

RANK_REASON User-generated benchmark of an open-source model on custom hardware. [lever_c_demoted from research: ic=1 ai=1.0]

Read on dev.to — LLM tag →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

DeepSeek V4.1 Flash benchmarked at 42 tok/s with 256K context on consumer GPUs

How we ranked this

Signal score
46 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Tool
User-generated benchmark of an open-source model on custom hardware. [lever_c_demoted from research: ic=1 ai=1.0]
Source corroboration
Single-source cluster
Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics
infra, model release
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
Breaking (< 6h)
Fresh story with cross-source coverage still developing. Ranking may shift as more sources report.

Full methodology in our editorial standards.

COVERAGE [1]

  1. dev.to — LLM tag TIER_1 English(EN) · KeithVal ·

    DeepSeek V4.1 Flash at 42 tok/s with 256K Context on RTX 5070 Ti x2 + 5060 Ti — Full Benchmark Record

    <p><em>This article is based on my own benchmark records, written by me together with Muse (an AI assistant). The original Japanese version is on <a href="https://zenn.dev/keithval/articles/deepseek-v41-flash-42tps-256k" rel="noopener noreferrer">Zenn</a>.</em></p> <p>I run DeepS…