OpenHermes
PulseAugur coverage of OpenHermes — every cluster mentioning OpenHermes across labs, papers, and developer communities, ranked by signal.
-
Qwen models lead open-weight AI in efficiency, hinting at sparser future
Qwen models are reportedly at the forefront of open-weight models, achieving Pareto frontiers in both total and active parameter sizes. This suggests a potential future with sparser, more capable, and faster AI models, …
-
User trains 1.1B LLM from scratch for $200, shares code and model
A user has successfully trained a 1.1 billion parameter large language model from scratch for approximately $200. The model, named 'gemmeh', was pre-trained on 20 billion tokens from the fineweb-edu dataset and then fin…
-
Open-source LLM efficient frontier charted by parameter efficiency
A Reddit user has compiled a chart illustrating the efficient frontier of open-source large language models, defining efficiency as the model's score relative to its active parameters. The chart focuses on models that r…