Muhammad Azlan Qazi

TRACE framework enhances distributed Transformer inference on edge devices

Researchers have developed TRACE, a novel framework for communication-efficient distributed inference of Transformers on edge devices. TRACE utilizes a Vector Quantizer (VQ) in each Transformer layer to encode activatio…