PulseAugur
EN
LIVE 21:38:26
Italiano(IT) Update : Small model + Engram

Developer releases new 2B parameter AI model 'Engram' with novel token probability table

By PulseAugur Editorial · [1 sources] ·

A developer has created a new 2 billion parameter model called Engram, which utilizes a 1 billion parameter Engram table for enhanced token probability. Despite training on only 15 million tokens, the model demonstrates surprising coherence, avoiding common early-stage repetition issues. The developer, who has prior experience in ML and red teaming at Anthropic, aims to release the model under an Apache 2.0 license for community use, noting it is trainable on 24GB of VRAM. AI

IMPACT Offers a novel approach to small model training, potentially enabling more accessible AI development.

RANK_REASON Developer's release of a novel, small-parameter AI model with unique architectural components. [lever_c_demoted from research: ic=1 ai=1.0]

Read on r/LocalLLaMA →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

Developer releases new 2B parameter AI model 'Engram' with novel token probability table

How we ranked this

Signal score
2 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Tool
Developer's release of a novel, small-parameter AI model with unique architectural components. [lever_c_demoted from research: ic=1 ai=1.0]
Source corroboration
Single-source cluster
Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics
model release, product
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
Same-day
Cluster formed today. Ranking reflects the current source set at time of score.

Full methodology in our editorial standards.

COVERAGE [1]

  1. r/LocalLLaMA TIER_1 Italiano(IT) · /u/NineThreeTilNow ·

    Update: Small model + Engram

    <!-- SC_OFF --><div class="md"><p>I posted something about a 9b model a few days ago.</p> <p>The real problem was 2 fold. Someone suggested the size was too big to prove it all out. It's a fair argument. I needed the model depth though. The second problem was the &quot;ability&qu…

RELATED ENTITIES

RELATED TOPICS