A user on r/LocalLLaMA shared benchmarks comparing two AMD EPYC processors, the 9135 and 9374f, for running local large language models. The 9374f, with its 8 Core Complex Dies (CCDs), was expected to offer an advantage, but initial tests showed no decoding improvement over the 9135. However, when using 48 threads, the 9374f demonstrated superior performance in certain scenarios, though it was still considered worse for gaming. AI
IMPACT Hardware choices can significantly impact the performance and cost-effectiveness of running local LLMs.
RANK_REASON User-generated benchmark of hardware for AI tasks.
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →
