User finds CPU-only setup fastest for Qwen and Gemma LLMs

A user shared their initial experiences setting up large language models on a new mini-PC with an Intel 285HX CPU and 64GB of RAM, aiming for CPU-only operation. They tested Qwen3, Qwen3.6, and Gemma4 models using Llama.cpp, comparing performance across Vulkan, SYCL, and CPU-only backends. Contrary to expectations, the CPU-only setup yielded the fastest token generation speeds, with the Qwen models proving particularly usable. AI

IMPACT Provides insights into optimal hardware and software configurations for running LLMs locally.

RANK_REASON User testing of LLM performance on specific hardware.

Read on r/LocalLLaMA →

• Gemma4
• Llama.cpp
• MS-02 Intel 285hx
• Qwen3
• Qwen3.6

• infra
• product

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →