Sharat Nellutla

New framework optimizes LLM inference energy use on multi-GPU systems

Researchers have developed EnergyLens, a framework designed to optimize the energy consumption of large language models (LLMs) during inference on multi-GPU systems. This tool addresses the challenge of predicting and r…