Jiaming Cheng

LLM inference efficiency explored on edge devices and cloud GPUs

Two new research papers explore the challenges of running large language models (LLMs) efficiently. The first paper investigates the performance trade-offs of deploying LLMs on edge devices like smartphones and speciali…