Philipp Zähl

LLM energy efficiency on consumer GPUs varies by architecture, not just size

A new paper benchmarks the energy efficiency of locally deployed large language models (LLMs) on consumer hardware, revealing that factors beyond parameter count, such as model architecture and quantization, significant…