IBM's Granite 4.1 reverts to transformer, users report slower speeds

IBM's Granite 4.1 model has reverted to a pure transformer architecture from Granite 4's hybrid mamba attention model. Users report that Granite 4.1 has a significantly reduced context window and slower processing speeds compared to its predecessor. This change has led to questions about IBM's future architectural choices and whether the mamba hybrid approach will be continued. AI

IMPACT Reversion to transformer architecture in Granite 4.1 may impact performance and usability for specific tasks.

RANK_REASON User discussion about architectural changes in a released model, comparing performance and features. [lever_c_demoted from research: ic=1 ai=1.0]

Read on r/LocalLLaMA →

• Granite 4
• Granite 4.1
• IBM

• model release
• other

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →