A user on r/LocalLLaMA shared their experience comparing two Mixture-of-Experts (MoE) engines, Strata and Basalt. After a month of using Strata, which offered significant improvements over llama.cpp, the user found it prone to context errors. They recently switched to Basalt and reported even faster performance, fewer errors, and more accurate reasoning, achieving 110-170 tokens/sec compared to Strata's 70-110 tokens/sec with the same Qwen3.8 FlashNext-ud-q4_k_xl model. AI
IMPACT Provides insights into performance differences between local LLM inference engines, aiding users in optimizing their setups.
RANK_REASON User comparison of two software tools for running local LLMs.
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →