PulseAugur
EN
LIVE 14:46:00

Most Downloaded Gemma 4 E4B Model Found to Be Broken

A comparison of 23 Gemma 4 E4B models found that the most downloaded model, OBLITERATUS/gemma-4-E4B-it-OBLITERATED, is completely broken and performs poorly. The "heretic" variants generally performed best, maintaining high accuracy while preserving model capabilities. Other models like gemma-4-E4B-it-abliterix showed high refusal rates but at the cost of some capability. AI

IMPACT Highlights the importance of rigorous benchmarking over download counts for open-source models.

RANK_REASON This is a comparative analysis of multiple open-source models, detailing their performance and identifying issues, which falls under research. [lever_c_demoted from research: ic=1 ai=1.0]

Read on r/LocalLLaMA →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

Most Downloaded Gemma 4 E4B Model Found to Be Broken

COVERAGE [1]

  1. r/LocalLLaMA TIER_1 English(EN) · /u/nathandreamfast ·

    23 Gemma4-E4B models compared with abliterlitics: the most downloaded one is also the most broken

    <!-- SC_OFF --><div class="md"><p>This is our <strong>biggest</strong> comparison yet. We've taken 23 Gemma 4 E4B models from huggingface and ran them through the <a href="https://github.com/dreamfast/abliterlitics">abliterlitics</a> gauntlet.</p> <p>We also have a new <a href="h…