PulseAugur
EN
LIVE 13:11:29

DeepSeek V4 flash version shows strong performance on MMLU-Pro, GPQA Diamond

DeepSeek V4 has released a new "flash" version, reportedly achieving impressive scores on benchmarks like MMLU-Pro, GPQA Diamond, and TruthfulQA. The model is noted for its strong performance relative to its size, with the DeepSeek team receiving congratulations for the update. AI

IMPACT This new version of DeepSeek V4 could set new performance benchmarks for models of its size, potentially influencing future model development and evaluation.

RANK_REASON The cluster reports on benchmark results for a specific model version, indicating a research milestone. [lever_c_demoted from research: ic=1 ai=1.0]

Read on r/LocalLLaMA →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

DeepSeek V4 flash version shows strong performance on MMLU-Pro, GPQA Diamond

COVERAGE [1]

  1. r/LocalLLaMA TIER_1 English(EN) · /u/maxpayne07 ·

    NEW Deepseek V4 Flash : MMLU-Pro , GPQA Diamond and truthfulQA ?

    <!-- SC_OFF --><div class="md"><p>About the new deepseek v4 flash version / update, does anybody now about the new values about: </p> <p>MMLU-Pro</p> <p>GPQA Diamond </p> <p>TruthfulQA </p> <p>About the other values, its outstanding for a model this size, congrats deepseek team</…