PulseAugur
EN
LIVE 21:52:48

Scotoma-2 fine-tune improves Gemma4 writing by reducing tics

Scotoma-2 is a fine-tuned version of the Gemma4 model, developed to address specific writing tics and improve prose quality. The model's creator, AesSedai, employed a methodology involving Heratic and J-lense projection to reduce the assistant persona, which was believed to be the source of issues like repetitive sentence structures and unnatural phrasing. Further refinement was achieved through DPO fine-tuning using custom datasets that contrasted accepted and rejected outputs, aiming to preserve the model's core intelligence while subtly altering its writing style. AI

IMPACT Offers an improved writing style for the Gemma4 model, potentially enhancing user experience in specific applications.

RANK_REASON This is a fine-tuned model release based on an existing model, with details on methodology and results. [lever_c_demoted from research: ic=1 ai=1.0]

Read on r/LocalLLaMA →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

Scotoma-2 fine-tune improves Gemma4 writing by reducing tics

COVERAGE [1]

  1. r/LocalLLaMA TIER_1 English(EN) · /u/CelvestianNesy ·

    Scotoma-2: Gemma4, but with less annoying slop and better writing.

    <table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1vhf70c/scotoma2_gemma4_but_with_less_annoying_slop_and/"> <img alt="Scotoma-2: Gemma4, but with less annoying slop and better writing." src="https://external-preview.redd.it/RPPk3lYSeq9oFJRYTVqjF_2UQQsZA4XtoX…