Pratyush Dhingra

New 3D Architecture ThAME Accelerates LLM Mixture of Experts Inference

Researchers have developed ThAME, a novel 3D heterogeneous multi-chiplet architecture designed to accelerate the inference of Large Language Models (LLMs) that utilize Mixture of Experts (MoE) architectures. ThAME addre…