A user has successfully expanded Google's Gemma4-31B model to 44 billion parameters by increasing its layers from 60 to 88. This modification, achieved through trial and error and a specific layer scalar fix, aims to create more capacity for new data domains. The user is seeking collaboration on improving the model's coding and tool-calling abilities, and is open to further architectural expansions. AI
IMPACT Demonstrates community-driven model expansion and highlights potential for increasing parameter counts through architectural modifications.
RANK_REASON User-driven modification of an existing model, not a first-party release.
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →
