A lawyer running PLI Labs has published performance benchmarks for the DeepSeek-V4.1-Flash model, utilizing a complex hardware setup. The configuration includes two DGX Spark servers for the model and a separate box with two 3090 GPUs for speculative drafting and Engram table offloading. This setup achieved over 2,600 tokens/s for prefill on a 256K context and 322 tokens/s for structured output, with full stack code and raw data made publicly available. AI
IMPACT Provides detailed performance data for a specific model and hardware configuration, useful for operators optimizing inference.
RANK_REASON Publication of performance benchmarks and technical details for an open-source model. [lever_c_demoted from research: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →