A user on r/LocalLLaMA has modified the Ornith1.5 35B A3B model, achieving a 33% reduction in task completion time and a 3% increase in tokens per second. This optimization involved splicing a trained MTP head from another model onto the Ornith1.5 base. The user reports that this enhanced version is faster and more accurate than previous iterations, even performing well in specific applications like controlling a HAM radio rig without generating lectures. AI
IMPACT Demonstrates potential for community-driven performance enhancements in open-source LLMs.
RANK_REASON User-driven optimization of an existing open-source model, not a frontier release from a major lab.
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →
