Does CPU matter for GPU inference?
A user on the r/LocalLLaMA subreddit is seeking advice on building a PC for large language model (LLM) inference. They want to prioritize GPU spending and minimize costs for other components. The core question is whether the CPU and RAM significantly impact inference performance when using powerful GPUs, specifically asking about potential penalties with older or lower-tier CPUs. AI