Windows vs. Linux: No Speed Difference for llama.cpp MoE Models

A user tested the performance of llama.cpp on Windows 11 and Linux, finding no significant speed difference for medium to large Mixture of Experts (MoE) models. The tests involved specific hardware configurations and detailed launch parameters, with results showing comparable prompt processing (PP) and token generation (TG) speeds across both operating systems. The user also noted that Windows Subsystem for Linux (WSL) performed slower than native Linux or Windows. AI

IMPACT Confirms that OS choice does not significantly impact performance for local LLM inference with llama.cpp.

RANK_REASON User-conducted benchmark comparing performance of software on different operating systems. [lever_c_demoted from research: ic=1 ai=0.7]

Read on r/LocalLLaMA →

• Linux
• llama.cpp
• MiniMax 2.7
• Qwen 3.5 122B
• Qwen 3.5 397B
• Windows 11
• WSL

• infra
• other

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →