English(EN) Are there any experimental small models (9B or less) which are out or currently being trained using engram/n-grams?

研究人员探索使用n-gram技术的小型AI模型

作者 PulseAugur 编辑部 · [1 个来源] · 2026-09-13 21:29

一位Reddit r/LocalLLaMA板块的用户正在询问是否存在利用n-gram或en-gram技术训练的实验性小型语言模型（90亿参数或以下）。用户注意到Hugging Face上缺乏此类模型，并表示有兴趣比较在相同数据集上使用和不使用n-gram训练的小型模型的性能。 AI

影响在小型语言模型中探索n-gram技术可能带来新的训练方法论和潜在更高效的模型架构。

排序理由该条目是论坛上关于潜在AI模型开发的用户的询问，而非发布或公告。

AI 生成摘要 · Google Gemini · 来自 1 个来源。我们如何撰写摘要 →

本文如何被排名

Signal score: 1 / 100; Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket: Commentary; 该条目是论坛上关于潜在AI模型开发的用户的询问，而非发布或公告。
Source corroboration: Single-source cluster; Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics: model release, other; Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance: High; Clearly on-topic for AI-industry coverage.
Story freshness: Breaking (< 6h); Fresh story with cross-source coverage still developing. Ranking may shift as more sources report.

完整方法见我们的编辑标准。

r/LocalLLaMA TIER_1 English(EN) · /u/OuterKey · 2026-09-13 21:29

是否有任何实验性的小型模型（9B或更少）已经发布或正在使用en-gram/n-grams进行训练？

<div class="md"><p>Not sure if anyone out there is working on this, don't see any on huggingface to try out. It might be too new at the moment, but it would be cool to see the difference between a tiny model trained with n-gram and without n-gram on the same datase…