Was BitNet a dead end? What happened to ternary LLMs?
Ternary LLMs, which use a three-value system for weights, showed early promise but have not seen significant development. The largest available ternary model is only 2 billion parameters, and major AI labs have not adopted this approach. It remains unclear why this architecture has stalled, despite its potential benefits. AI
IMPACT Ternary LLMs have not gained traction, indicating a lack of industry-wide impact or adoption for this specific architecture.