PulseAugur
EN
LIVE 13:18:02

Gemma 12B Reasoning Improved with Custom System Instruction

A user on the r/LocalLLaMA subreddit has shared a system instruction designed to improve the reasoning capabilities of the Gemma 12B model. The instruction aims to mitigate cognitive biases and encourage the model to base its answers strictly on provided premises, while also preventing overthinking on simpler tasks. While not perfect, the user reports that this prompt has shown success in handling trickier reasoning questions and performing well on standard queries, though it still struggles with specific scenarios like the 'car wash' problem. AI

IMPACT Demonstrates how prompt engineering can enhance the reasoning abilities of smaller, locally runnable LLMs.

RANK_REASON User-generated prompt engineering for an existing model.

Read on r/LocalLLaMA →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

COVERAGE [1]

  1. r/LocalLLaMA TIER_1 English(EN) · /u/nixudos ·

    Gemma 12b - Reasoning hardening instructions

    <!-- SC_OFF --><div class="md"><p>I've become quite happy with Gemma 12b QAT as a general assistant lately.<br /> It is small enough to run on my PC while still leave plenty of VRAM free for other tasks and fast enough that I I don't have to go make coffee while it thinks.</p> <p…