Users of consumer-grade hardware are noticing a trend where new large language model releases are predominantly in the 27B parameter size and larger, with fewer new models appearing in the 8B-12B range. This shift is leaving users with limited RAM, such as those with 16GB on a Macbook Pro M4, struggling to find up-to-date models that fit their system's capabilities. The question arises whether it is becoming technically infeasible to develop high-performing state-of-the-art models within the smaller 8B-12B parameter class. AI
IMPACT Smaller, more accessible models may become less common, potentially limiting access for users with less powerful hardware.
RANK_REASON User discussion on Reddit about a perceived trend in LLM release sizes.
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →
