PulseAugur
EN
LIVE 10:24:49

User creates custom 'high' reasoning mode for 27B LLMs

A user on Reddit has developed a custom "high" reasoning mode for 27B language models, aiming to bridge the gap between the existing "low" and "xhigh" modes. The "medium" mode was found to degrade performance, leading the user to experiment with blending prompts. The resulting "high" mode produces reasoning outputs that are shorter than "xhigh" but maintain good quality, making the model more efficient and enjoyable to use. AI

IMPACT Offers a potential improvement for users seeking more efficient reasoning from 27B models.

RANK_REASON User-created modification to an existing model's behavior, not a new model release or significant research.

Read on r/LocalLLaMA →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

User creates custom 'high' reasoning mode for 27B LLMs

COVERAGE [1]

  1. r/LocalLLaMA TIER_1 English(EN) · /u/TokenRingAI ·

    Try out this "high" reasoning mode for 27B (tested on VLLM)

    <!-- SC_OFF --><div class="md"><p>After a lot of tweaking, I have come to the conclusion that 27B lacks a reasoning mode that is between low and xhigh.</p> <p>The &quot;medium&quot; mode isn't actually medium, it erases the explicit instructions to the model. When medium is enabl…